INDUSTRY FIELD GUIDE
Central bank data vintages for AI evaluation
The latest economic series can contain revisions unavailable when an analyst wrote a prior note.
NAICS 521110 · Monetary Authorities-Central Bank
The latest economic series can contain revisions unavailable when an analyst wrote a prior note. The St. Louis Fed’s ALFRED service preserves published vintages. A benchmark can test whether an assistant uses the values a reader actually had at a specified time. ALFRED archive · St. Louis Fed vintage dates documentation
Choose a series with verified reuse terms, or create a fictional series. Give one observation two publication dates and values. Add a note dated between releases. Ask the assistant what the note could cite at that time and whether a later correction changes the retrospective comparison. Score observation date, publication date, units, and source citation separately. A useful second case has no record available as of the requested date.
Keep restricted policy materials, internal forecasts, embargoed releases, and participant identities out of the exercise. Public availability and reuse rights are separate checks, particularly when the archive credits a third-party data publisher.
Describe a release-vintage benchmark
Original Fiund exercise
A later revision cannot appear in an earlier analyst's information set
A wholly invented economic series uses index points and dated publication cards. It contains no actual central-bank data or claim about historical economic conditions.
| Record | Source | What it records |
|---|---|---|
| CV1 | Initial release | Observation period January: 102.0 index points, first published February 5. |
| CV2 | Revision release | Same January observation: 101.4 index points, published March 5. Revision explicitly replaces the earlier January value in the current series. |
| CV3 | Analyst note date | Note dated February 20 asks about January. A second question asks for a February observation as of February 20, before its fictional March 5 first release. |
Question for the model
Which January value was available for the February 20 note, and was a February observation available under the supplied release history?
Show the reference answer and checks
CV1's 102.0 was published before the note, while CV2's 101.4 revision was not available until March 5. Use 102.0 for the February 20 information set and retain 101.4 as the later revised January value. CV3 gives no February observation released by February 20. Do not backfill it from March or confuse the observation month with the date a reader could first access a value.
- Using today's revised series as if its values were known on an earlier date.
- Matching observation period while ignoring the first publication timestamp.
Fields to preserve
- Observation period
- Identifies what the value describes.
- Publication date and vintage
- Defines availability at the requested cutoff.
- Value, unit and revision link
- Preserves numerical meaning across releases.
Test another case
Move the note date to March 6. Require the revised January value and newly available February observation, with separate release citations.
Use original fictional series or separately cleared public data. Archive availability does not establish third-party reuse rights; exclude embargoes and internal forecasts.
Discuss a contribution
Describe the sources you control, the task they could support and what has already been checked. Use the existing-data assessment for an archive or the collection brief for a new recording project. The contributor agreement defines Fiund’s licensing authority and compensation. A guide or fictional exercise does not establish an accepted collection or a sale.