Tag Archives: open data

New releases to the Open Data Portal

Posted on by
Reply

Library and Archives Canada is extracting the datasets of studies undertaken by federal departments from outdated storage devices, and preserving them. The studies covering a wide range of topics, such as the environment, health and immigration, are being made available on the Open Data portal. To learn more about the structure of the data, see our blog Open Data: Providing access to historical Government of Canada studies.

Here is a list of some of the new datasets available on the Open Data portal:

Prices and Incomes Commission Datasets

Thirsk Project

This file contains general time series labour force, unemployment and vacancy data collected to support a Prices and Incomes Commission study on the regional characteristics of inflation and unemployment. The data cover the time period between 1949 and 1971.

Lewis Project

The data pertain to general time series econometric data contributions to Prices and Incomes Commission studies into the validity of existing economic theories on wages and the allocation of labour. The data in most cases are monthly and cover the time period between 1935 and 1971.

Lazar Project

The data relate to general time series econometric data and social statistics concerning the state of Canada’s labour force. The data cover the time period between 1950 and 1970.

Scharfe Project

The dataset contains general time series econometric data contributing to a Prices and Incomes Commission study on inflation in the Canadian economy. The data cover the time period between 1961 and 1969.

Itinerant movements 1971, 1972, 1973, 1974 and 1975

These datasets contain yearly aircraft movement statistics in Canada. Itinerant movement is one in which the aircraft taking off or landing is known to be leaving or entering the airport tower control zone.

Canadian industrial organization

The data contain variables relating to the structure, conduct, and performance of manufacturing industries in Canada as well as to the American industries that are counterparts of the sample of Canadian industries. The data were collected and cover the time period from 1975 to 1976.

Open datasets – update

Posted on by
Reply

Library and Archives Canada is in the process of extracting from outdated storage devices, and then preserving, the datasets of studies undertaken by federal departments. The studies, covering a wide range of topics-including the environment, health, and immigration–are being made available on the Open Data portal. To learn more about the structure of the data, see Open Data: Providing access to historical Government of Canada studies.

In the coming months, Library and Archives Canada will be releasing the following datasets:

Alouette I synoptic data

The data result from radio sounding of the ionosphere by the Alouette I satellite. The data sets being released relate to data collected from May 1, 1963, to December 31, 1966.

Water Survey of Canada

The Water Survey of Canada has been collecting and publishing hydrometric data since 1908. Five categories of data were collected between 1908 and 1979:

  • FLOW files – historical daily, monthly and annual streamflow data from stations across Canada
  • LEVELS file – historical daily, monthly and annual water level data from stations across Canada
  • HYDEX file – descriptive information for hydrometric gauging stations (streamflow and water level)
  • PEAKS file – annual maximum instantaneous discharges or water levels from some 1,400 gauging stations across Canada
  • SEDEX file – historical daily mean suspended sediment concentrations in milligrams per litre from gauging stations across Canada

Food Prices Review Board

The results from several food price studies undertaken between 1973 and 1976 will be released:

  • Average retail food prices in major cities across Canada
  • Availability of comparative price information and effects on consumers’ purchasing decisions
  • Price data on dairy foods in major cities across Canada
  • Costs and benefits of meat specials merchandizing practices
  • Beef and pork prices in major cities across Canada

Open government 101

Posted on by
2

The first time many of us heard of Open Government may have been in 1980, in the pilot episode of the BBC series “Yes Minister.” The first policy idea of newly-appointed minister Jim Hacker was being “open”; giving citizens the chance to connect with the people they had just elected.

Long-serving civil servant Sir Humphrey Appleby was dismayed at this idea, explaining that open government was an absurd concept—one must choose between being open or governing.

Today, citizens and governments across the globe disagree with Sir Humphrey’s outdated ideas. Indeed more than 68 countries have joined the Open Government Partnership (OGP), a multilateral initiative that advocates openness within government to promote transparency and empower citizens.

Canada joined the OGP in 2011 and the Treasury Board of Canada Secretariat released our first Action Plan in 2012. This plan was founded on three pillars: Open Information; Open Data, and Open Dialogue. Our second Action Plan, which builds on the original commitments and adds new commitments in areas such as government spending and contracting data, will be completed this summer.

At Library and Archives Canada (LAC), our main commitment to Open Government centres on open information. We are committed to increasing access to archived federal documents among LAC’s holdings by removing restrictions on this information wherever possible. In February of 2015, we wrote a blog post about Block Review. We’re happy to report that this work continues and that we have now opened almost 18 million pages of records in our holdings! We’re also working to ensure that, wherever possible, government records will be open when transferred to us in the future.

This past summer, we told you about the work we’ve been doing with historical datasets—migrating datasets from our holdings to Canada’s Open Data Portal. To date, we have migrated over 40 datasets. Keep checking our blog to keep up to date with our new additions to the Portal.

Enough about us! How can you get involved? Open Government is about facilitating a two-way conversation. Add your voice to the conversation—the best place to start is the Open Government portal. It’s a one-stop shop for everything the federal government is doing in the Open Government arena (including current consultation opportunities).

Keep checking back for more Open Government updates!

Open Datasets – What’s New?

Posted on by
1

Library and Archives Canada is in the process of extracting from outdated storage devices, and then preserving, the datasets of studies undertaken by federal departments. The studies covering a wide range of topics, such as the environment, health and immigration, are being made available on the Open Data portal. To learn more about the structure of the data see our blog Open Data: Providing access to historical Government of Canada studies.

Here is a summary of the datasets we have made available over the past few months. Curious about what these studies discovered? Check them out on the Open Data portal

  1. Longitudinal study of immigrants – 1969–1971 arrivals
    This longitudinal study investigated the economic and social adaptation of immigrants to life in Canada.
  2. Canadian airmen of the First World War
    This file includes personnel information for all traceable Canadian airmen who served in the First World War in the British flying services.
  3. Results of Canadian Federal Elections 1974, 1979, 1980, 1984, 1988
    These files contain the voting records for each polling station, electoral district and province for all candidates in Canadian federal elections.
  4. Canadians and Work
    These studies were undertaken in the 1970s and relate to Canadians and work. They include national surveys undertaken to assess job satisfaction and work ethic, Public Service Staff Relations Board pay-rate surveys and an employment study assessing the employment adjustment processes of Canadian graduates in the physical sciences.
  5. Environment – Fire and Water
    • The Test fire, fuel moisture and weather observations datasets contain information collected between 1931 and 1961 about weather, fuel moisture and test fire behaviour measurements for eleven field stations across Canada.
    • The 1968-1979 Canadian Oceanographic Identification Centre dataset includes taxonomic data used to produce group, genus, and species catalogues for the Arctic, Atlantic and Pacific freshwater areas.
    • The St. Lawrence River studies were undertaken between 1974 and 1976 to describe the water properties, pollution levels and sediment quality of the St. Lawrence River.

Open Data: Health and Welfare Canada Drug Studies

Posted on by
Reply

In the 1970s, Health and Welfare Canada sponsored several studies on the use of prescribed drugs, alcohol, and cannabis as well as drug-related deaths. Raw statistical data from four sets of surveys has recently been migrated into ASCII character-encoding scheme. Specialized software such as a spreadsheet or statistical tool is required to open, interpret and analyze the data. A codebook is provided that describes the file structure of the data and defines the variables contained in each field. If you are interested in any of the surveys listed below, they are now available on the Open Data portal.

Consumption of prescribed drugs in Canada 1977

In 1977, Health and Welfare Canada sponsored two studies relating to the use of prescribed drugs in Canada. Some of the main survey findings revealed:

  • Analgesics and antibiotics were found to be the most frequently used in the general population.
  • Anti-hypertensive and cardiac medications were used by elderly respondents.
  • Females were over-represented among users of sedatives and tranquilizers.

National surveys of alcohol consumption in Canada

The purpose of the Dialogue on Drinking Campaign was to increase public awareness of drinking behavior and encourage community involvement in programs directed toward alcohol-related problems. The campaign was carried out in phases using a variety of advertising mediums such as newspapers, magazines, radio and television broadcasts. This advertising was followed up by a series of surveys to investigate the public’s awareness of the Dialogue on Drinking Campaign itself and the drinking habits of Canadians. In 1976, one survey also collected data on the smoking habits of Canadians.

Use of cannabis by adult Canadians

In 1978, Health and Welfare Canada sponsored a survey of adults aged 18 and over. Respondents were interviewed on their use and frequency of use of marihuana and/or hashish. The study was undertaken to determine trends in cannabis use, identify populations at risk, assess social correlates of cannabis use, and formulate policy.

Drug related deaths in metropolitan Toronto

This data was collected in 1973 from the records of 18 full-time and part-time coroners from the Toronto area. The data was extracted from files which recorded alcohol- or drug-related deaths and includes the general drug category, specific drug, form of alcohol, name of solvents and poisons involved.

Open Data: Providing access to historical Government of Canada studies

Posted on by
Reply

Canada’s Action Plan on Open Government details how the federal government is promoting transparency and accountability and encouraging citizen engagement by releasing unrestricted government data and information. Releasable information falls under two categories: structured data (machine readable) and open information (unstructured documents and multimedia assets). To make this information easily discoverable and reusable, it will be located on the Open Government website and made available under the unrestricted Open Government Licence. Structured data is made available through the Open Data portal of the website and unstructured information through the Open Information portal.

Library and Archives Canada is in the process of extracting and preserving datasets from outdated storage devices that are related to studies undertaken by federal departments. The studies cover a wide range of topics, such as the environment, health and immigration. The digital content from these studies, acquired since the early 1970s, is being converted from its outdated file structures and encoding schemes so it can be used by contemporary computers that are based on the ASCII encoding scheme.

Once the datasets are migrated, they will be made available on the Open Data portal. Codebooks that describe the file structure of the data and define the variables contained in each field will also be supplied. These migrated datasets will be in the form of raw data. To interpret and analyze the content in each file, you will require specialized software, such as a spreadsheet or a statistical tool. Raw data preserves the integrity of this archival content and will allow you to perform your own interpretation and analysis.

Stay tuned in the coming months for news about dataset releases.

Linked Open Data sets for the First World War

Posted on by
3

We are proud to report that Library and Archives Canada (LAC) has recently released a new data set on the Canadian Government Open Data portal as part of a First World War collaborative initiative with the Muninn Project. The project involved the partial transcription of the service records of soldiers who served in the Canadian Expeditionary Forces (CEF) during the First World War. LAC provided the digitized service files of 1,000 soldiers while the Munnin Project organized the crowdsourcing for the transcription and data linking of these historical documents. As a pilot project, the scope was limited to a specific medical form—the medical case sheet—which is found in most of the files and which contains information recorded by hospital staff on a specific soldier’s medical history.

Colour reproduction of a form which provides information on a soldier’s medical history. In this case, the soldier suffered a gunshot wound to the eye.

An example of a medical case sheet from the LAC collection – Private Addison Baker

The information that has been gathered from the transcriptions represents a spectrum of the types of health issues one would expect to occur in a large group of men. Some of the medical cases are directly related to combat injuries such as gunshot or shell wounds or shell shock. Others are related to the living conditions found in trenches which would increase ailments affecting the respiratory system and the outbreak of diseases such as influenza. A large proportion of the recorded information is just the everyday health issues of the time: toothaches, measles, etc.

To learn more about the information that was gathered from the service files, visit the First World War Linked Open Data project. The raw data is also available on the Canadian Open Data Portal in Linked Open Data and plain text format.