# ---
# jupyter:
#   jupytext:
#     text_representation:
#       extension: .py
#       format_name: light
#       format_version: '1.5'
#       jupytext_version: 1.14.4
#   kernelspec:
#     display_name: Python 3
#     language: python
#     name: python3
# ---

# # __*DATASHEET FOR LAURA.ipynb NOTEBOOK*__
#
#

# ## __*Motivation for Dataset Creation:*__
#
# ### Why was the dataset created? (e.g., were there specific tasks in mind, or a specific gap that needed to be filled?)
# 	VAERS, Vaccine Adverse Event Reporting System, was established to be a national early warning system to detect possible safety problems in U.S. licensed vaccines. The system accepts and analyzes reports of adverse events and possible side effects after vaccination has occurred. It was initially established in 1990 as a response to the National Childhood Vaccine Injury Act.  
#
# ### 	Objectives via VAERS website: 
# •	Detect new, unusual, or rare vaccine adverse events;
# •	Monitor increases in known adverse events;
# •	Identify potential patient risk factors for particular types of adverse events;
# •	Assess the safety of newly licensed vaccines;
# •	Determine and address possible reporting clusters (e.g., suspected localized [temporally or geographically] or product-/batch-/lot-specific adverse event reporting);
# •	Recognize persistent safe-use problems and administration errors;
# •	Provide a national safety monitoring system that extends to the entire general population for response to public health emergencies, such as a large-scale pandemic influenza vaccination program.
# ### What (other) tasks could the dataset be used for? Are there obvious tasks for which it should not be used?
# 	An obvious task that VAERS should not be used for is for the purpose of providing medical advice. This dataset can be used to do a retrospective analysis or an investigative analysis of different variables that can infer from year to year what has been the trend in vaccination formulation and if there is any correlation between the side effects. 
#
# From the website itself: “VAERS is not designed to determine if a vaccine caused a health problem but is especially useful for detecting unusual or unexpected patterns of adverse event reporting that might indicate a possible safety problem with a vaccine.”
#
# ### Has the dataset been used for any tasks already? If so, where are the results so others can compare (e.g., links to published papers)?
# 	It has been used in numerous academic publications that focus on vaccination safety and monitoring. This website links to academic papers by dataset year: https://www.cdc.gov/vaccinesafety/ensuringsafety/monitoring/vaers/publications.html
#
# ### Who funded the creation of the dataset? If there is an associated grant, provide the grant number.
# 	VAERS was created and is being co-managed by the Centers for Disease Control and Prevention along with the U.S. Food and Drug Administration, agencies of the U.S. Department of Health and Human Services. 
#
# ## __*Dataset Composition:*__
#
# ### What are the instances? (that is, examples; e.g., documents, images, people, countries) Are there multiple types of instances? (e.g., movies, users, ratings; people, interactions between them; nodes, edges) 
# 	The instances are the people who have reported events through the VAERS system. Anyone can report to the database. Health professionals, patients, parents, caregivers, etc. Their names are de-identified once reported. 
#
# ### Are relationships between instances made explicit in the data (e.g., social network links, user/movie ratings, etc.)? 
# 	There are no known relationships between instances besides the fact they are all individuals who willingly reported after a vaccination event. 
#
# ### How many instances of each type are there? 
# What are the instances? (that is, examples; e.g., documents, images, people, countries) Are there multiple types of instances? (e.g., movies, users, ratings; people, interactions between them; nodes, edges) 
# 	There are 44,504 instances. Unknown currently if an individual reported more than once as each reported event is given its own unique VAERS ID number. 
#
# ### What data does each insistence consist of? 
# 	Consists of raw data collected from fields that instances would input once a event occurred. Data includes demographic information, type of vaccination, classification, and narratives of adverse symptoms and the resulting measures taken. 
#
# ### Is everything included or does the data rely on external resources? 
# 	Since VAERS is a passive reporting system, it means that it relies on individuals to send in reports of their experiences to the CDC and FDA. Therefore, this data does not collect all vaccination events across the U.S., adverse event or not. 
#
# ### Are there recommended data splits or evaluation measures? 
# 	Unknown
#
# ### What experiments were initially run on this dataset? 
# 	Unknown if experiments were initially ran on the database, however since, the data set has been used to test different hypothesis on regulation and safety monitoring in regards to vaccination and its trends. 
#
# ## __*Data Collection Process:*__ 
#
# ### How was the data collected? (e.g., hardware apparatus/sensor, manual human curation, software program, software interface/API; how were these constructs/measures/methods validated?)
# 	https://vaers.hhs.gov/data/datasets.html
# 	Data was collected from the VAERS online self-reporting portal. 
#
# ### Who was involved in the data collection process?
# 	Unknown. Since data is self-reported, it is unknown who and how it was originally initiated (ex. private clinic reporting, large hospital, call to CDC, etc). 
# 	
# ### Over what time-frame was the data collected? 
# 	Data has been collected each year since 1990, however, not all years seem completed. 
#
# ### How was the data associated with each instance acquired? 
# 	Through survey linked on the CDC website. 
#
# ### Does the dataset contain all possible instances? Or is it, for instance, a sample (not necessarily random) from a larger set of instances? 
# 	Does not contain all possible instances. Unreporting is an issue. 
#
# ### If the dataset is a sample, then what is the population? What was the sampling strategy (e.g., deterministic, probabilistic with specific sampling probabilities)? Is the sample representative of the larger set (e.g., geo- graphic coverage)? If not, why not (e.g., to cover a more diverse range of instances)? How does this affect possible uses? 
# 	Unknown. Since it is self-reporting, we cannot determine how representative the set is. 
#
# ### Is there information missing from the dataset and why? (this does not include intentionally dropped instances; it might include, e.g., redacted text, withheld documents) Is this data missing because it was unavailable? 
# 	Yes, it does not include instances when no adverse event has occurred. It also does not contain all the vaccines where an adverse event has occurred since this is self-reported and not required to be completed by a medical professional or patient. 
#
# ### Are there any known errors, sources of noise, or redundancies in the data? 
# 	Unknown. 
#
# ## __*Data Preprocessing:*__ 
#
# ### What preprocessing/cleaning was done? 
# 	Unknown. 
#
#
# ### Was the “raw” data saved in addition to the preprocessed/cleaned data? (e.g., to support unanticipated future uses)
# 	Unknown. 
#
# ### Is the preprocessing software available? 
# 	Unknown.
#
# ### Does this dataset collection/processing procedure achieve the motivation for creating the dataset stated in the first section of this datasheet?
# 	There are potential limitations to the dataset which might bias the data towards a particular demographic or event. 
#
# ## __*Data Distribution:*__
#
# ### How is the dataset distributed? (e.g., website, API, etc.; does the data have a DOI; is it archived redundantly?)
# 	Can be downloaded from https://vaers.hhs.gov/data.html in raw data in CVS files. 
#
# ### When will the dataset be released/first distributed? 
# 	This particular database for 2015 reporting was released on  July 2016. 
#
# ### What license (if any) is it distributed under? Are there any copyrights on the data?
# 	VAERS is in the public domain. 
#
# ### What license (if any) is it distributed under? Are there any copyrights on the data? 
# Are there any fees or access/export restrictions? 
# 	No. 
#
# ## __*Dataset Maintenance:*__
#
# ### Who is supporting/hosting/maintaining the dataset? How does one contact the owner/curator/manager of the dataset (e.g. email address, or other contact info)?
# 	VAERS is co-sponsored by the Centers for Disease Control and Prevention (CDC), and the Food and Drug Administration (FDA), agencies of the U.S. Department of Health and Human Services (HHS).
#
# ### Will the dataset be updated? How often and by whom? How will up- dates/revisions be documented (e.g., mailing list, GitHub)? Is there an erratum?
# 	Unknown.
#
# ### If the dataset becomes obsolete how will this be communicated? 
# 	Unknown. Mostly likely announced in a press release by the CDC and FDA.
#
#
# ### If others want to extend/augment/build on this dataset, is there a mechanism for them to do so? If so, is there a process for track- ing/assessing the quality of those contributions. What is the process for communicating/distributing these contributions to users?
# 	Unknown.  
#
# ## __*Legal & Ethical Considerations:*__
#
# ### If the dataset relates to people (e.g., their attributes) or was generated by people, were they informed about the data collection? (e.g., datasets that collect writing, photos, interactions, transactions, etc.)
# 	Yes, when an individual self-reports, they give their consent within the survey format that their data will be utilized for research purposes and deidentified to be made available to the public.  
#
# ### If it relates to other ethically protected subjects, have appropriate obligations been met? 
# 	CDC and FDA are public health authorities as defined by the Health Insurance Portability and Accountability Act (HIPAA), Standards for Privacy of Individually Identifiable Health Information; Final Rule (Privacy Rule) [45 CFR §164.501]. Pursuant to 45 CFR §164.512(b) of the Privacy Rule is applicable to the Vaccine Adverse Events Reporting System (VAERS). Subjects are thus protected under the HIPPA Privacy Rule. 
# 	
# ### If it relates to people, were they told what the dataset would be used for and did they consent? What community norms exist for data collected from human communications? If consent was obtained, how? Were the people provided with any mechanism to revoke their consent in the future or for certain uses? 
# 	Yes, it is transparent what the data will be used for when signing consent. Consent was obtained when subjects submitted their reports on their own. They self-reported and were required to sign off legal disclaimers. 
#
# ### If it relates to people, could this dataset expose people to harm or legal action? (e.g., financial social or otherwise) What was done to mitigate or reduce the potential for harm?
# 	 No. Data is de-identified under HIPPA privacy laws. 
#
# ### If it relates to people, does it unfairly advantage or disadvantage a particular social group? In what ways? How was this mitigated? 
# 	Potentially. Since this is a passive reporting system, marginalized communities might not have access to this database or know that such information is actively being collected. 
#
# ### If it relates to people, were they provided with privacy guarantees? 
# 	Yes. HIPPA privacy protection. 
#
# ### Does the dataset comply with the EU General Data Protection Regu- lation (GDPR)? Does it comply with any other standards, such as the US Equal Employment Opportunity Act?
# 	Unknown. 
#
# ### Does the dataset contain information that might be considered sensitive or confidential? (e.g., personally identifying information)
# 	Yes. Personal demographic and health data information are being collected. 
#
# ### Does the dataset contain information that might be considered inappropriate or offensive?
# 	No. 
# 	
#  
#
#
#
#





StarcoderdataJupyterScriptsDedupFiltered