Jump to content

Information hazard

From Wikipedia, the free encyclopedia
(Redirected from Infohazard)

An information hazard, or infohazard,[1] is "a risk that arises from the dissemination of (true) information that may cause harm or enable some agent to cause harm," as defined by philosopher Nick Bostrom in 2011, or as defined in the concept of information sensitivity. It is an idea that contradicts the idea of freedom of information as it states that some types of information are too dangerous for every single person to have access to, as they could either be harmed by it or harm others.[2] This is sometimes why information is classified based on its sensitivity. One example would be instructions for creating a thermonuclear weapon.[3] Following these instructions could cause massive amounts of harm to others, therefore limiting who has access to this information is important in preventing harm to others.

Classification

[edit]

According to Bostrom, there are two defined major categories of information hazard. The first is the "adversarial hazard"[3] which is where some information can be purposefully used by a bad actor to hurt others. The other category is where the harm is not purposeful, but is merely an unintended consequence that harms the person who learns it.[3]

Bostrom also proposes several subsets of these major categories, including the following types:[3]

  • Data hazards: A piece of data that can be used to harm others, such as the DNA sequence of a lethal pathogen.[3]
  • Idea hazards: General ideas that can harm others if fulfilled. One example is the idea of "using a fission reaction to create a bomb". Knowing this idea alone can be enough for a well-resourced team to develop a nuclear bomb.[3]: 3 
  • Knowing-too-much hazards: Information that if known, can cause danger to the person who knows it. For example, in the 1600s, women who allegedly possessed knowledge of the occult or of birth control methods were at a higher risk of being accused of witchcraft.[3]: 9 [4]

In biotechnology

[edit]

According to Bostrom, data hazards are of particular interest to the fields of biology and pathology. Knowledge of potentially dangerous strains of disease can cause widespread panic if picked up by media or third parties through fearmongering or improper analysis of disease outbreaks by untrained people.[5] Some experts in these fields want to improve the peer review process in order to avoid these issues by stopping the release of unverified information.

Additionally, the availability of information on DNA sequences of diseases or the chemical makeup of toxins could lead to adversarial hazards, as bad actors could use this information in order to recreate these biohazards on their own.[6]

In information security

[edit]

According to Bostrom, the concept of information hazards is also relevant to information security. Many government, public, and private entities have information that could be classified as a data hazard that could harm others if leaked. This could be the result of an adversarial hazard or an idea hazard. To avoid this, many organizations implement security controls depending on their own needs or the needs laid out by regulatory bodies.[7]

An example of this Health Insurance Portability and Accountability Act which in part works to avoid the loss of information about medical patients in the United States which could result in adversarial hazards. Part of this act is designed to create a standardized means of concealing information that could be used to harm others by keeping the information available only to those who have to know it.[8]

In law

[edit]

Willful blindness is an attempt to avoid obscuring or misleading a case by avoiding the idea that a fact is true if it cannot be proven from the knowledge. This is an attempt to avoid information hazards that could harm a legal case by putting false or assumed information in the mind of the jury.[9]

In literature

[edit]

The idea of forbidden knowledge that can harm the person who knows it is found in many stories in the 16th and 17th centuries. In it, these stories imply or explicitly state that some knowledge is dangerous for the viewer or for others and is better left hidden.[10]

[edit]

The idea of an information hazard overlaps with the idea of a harmful trend or social contagion. In it, knowledge of certain trends can result in their replication, such as in the case of certain viral trends that can be physically dangerous to those who attempt them.[11]

See also

[edit]

References

[edit]
  1. ^ Wortmann, Fletcher (28 August 2019). "Infohazard Warning: How Internal Memes Infect Your Brain". Psychology Today. Retrieved 14 May 2021.
  2. ^ Bostrom, Nick (2011). "Information Hazards: A Typology of Potential Harms from Knowledge" (PDF). Review of Contemporary Philosophy. 10: 44–79.
  3. ^ a b c d e f g Bostrom, Nick. "Information Hazards: A Typology of Potential Harms from Knowledge" (PDF). Review of Contemporary Philosophy. 10: 44–79.
  4. ^ Levack, B.P (1987). The Witch-Hunt in Early Modern Europe.
  5. ^ Esvelt, Kevin M. (2018-10-04). Coyne, Carolyn B. (ed.). "Inoculating science against potential pandemics and information hazards". PLOS Pathogens. 14 (10): e1007286. doi:10.1371/journal.ppat.1007286. ISSN 1553-7374. PMC 6171951. PMID 30286188.
  6. ^ Lewis, Gregory; Millett, Piers; Sandberg, Anders; Snyder-Beattie, Andrew; Gronvall, Gigi (May 2019). "Information Hazards in Biotechnology". Risk Analysis. 39 (5): 975–981. Bibcode:2019RiskA..39..975L. doi:10.1111/risa.13235. ISSN 0272-4332. PMC 6519142. PMID 30419157.
  7. ^ Force, Joint Task (2020-12-10). Security and Privacy Controls for Information Systems and Organizations (Report). National Institute of Standards and Technology.
  8. ^ Edemekong, Peter F.; Annamaraju, Pavan; Haydel, Micelle J. (2023), "Health Insurance Portability and Accountability Act", StatPearls, Treasure Island (FL): StatPearls Publishing, PMID 29763195, retrieved 2023-11-12
  9. ^ Freeman, Jason B. (2020-07-29). "Willful Blindness and Corporate Liability". Freeman Law. Retrieved 2023-11-14.
  10. ^ Ginzburg, Carlo (1976). "High and Low: The Theme of Forbidden Knowledge in the Sixteenth and Seventeenth Centuries". Past and Present (73): 28–41. doi:10.1093/past/73.1.28. ISSN 0031-2746.
  11. ^ "Dangerous Social Media Challenges: Understanding Their Appeal to Kids". HealthyChildren.org. 9 April 2018. Retrieved 2023-11-14.