Artificial basic intelligence (AGI) is a kind of artificial intelligence (AI) that matches or surpasses human cognitive capabilities across a large range of cognitive jobs. This contrasts with narrow AI, which is limited to particular tasks. [1] Artificial superintelligence (ASI), on the other hand, describes AGI that considerably exceeds human cognitive capabilities. AGI is thought about one of the meanings of strong AI.
Creating AGI is a primary objective of AI research study and of business such as OpenAI [2] and Meta. [3] A 2020 survey determined 72 active AGI research study and advancement projects throughout 37 nations. [4]
The timeline for achieving AGI stays a subject of continuous dispute amongst researchers and professionals. Since 2023, some argue that it may be possible in years or years; others keep it may take a century or longer; a minority think it might never ever be achieved; and another minority claims that it is already here. [5] [6] Notable AI scientist Geoffrey Hinton has expressed issues about the fast development towards AGI, suggesting it might be attained faster than lots of expect. [7]
There is argument on the specific definition of AGI and relating to whether modern-day big language models (LLMs) such as GPT-4 are early forms of AGI. [8] AGI is a typical topic in sci-fi and futures studies. [9] [10]
Contention exists over whether AGI represents an existential threat. [11] [12] [13] Many specialists on AI have mentioned that mitigating the risk of human termination positioned by AGI should be a worldwide top priority. [14] [15] Others find the advancement of AGI to be too remote to present such a threat. [16] [17]
Terminology
AGI is likewise understood as strong AI, [18] [19] complete AI, [20] human-level AI, [5] human-level intelligent AI, or basic smart action. [21]
Some academic sources book the term "strong AI" for computer system programs that experience life or consciousness. [a] On the other hand, weak AI (or narrow AI) has the ability to fix one specific issue however lacks general cognitive capabilities. [22] [19] Some academic sources use "weak AI" to refer more broadly to any programs that neither experience consciousness nor have a mind in the very same sense as human beings. [a]
Related principles include synthetic superintelligence and transformative AI. A synthetic superintelligence (ASI) is a hypothetical type of AGI that is a lot more usually smart than humans, [23] while the notion of transformative AI connects to AI having a large influence on society, for example, similar to the agricultural or industrial revolution. [24]
A framework for categorizing AGI in levels was proposed in 2023 by Google DeepMind researchers. They define five levels of AGI: emerging, skilled, specialist, virtuoso, and superhuman. For example, a proficient AGI is specified as an AI that surpasses 50% of competent adults in a large range of non-physical tasks, and a superhuman AGI (i.e. a synthetic superintelligence) is similarly specified however with a limit of 100%. They consider big language designs like ChatGPT or LLaMA 2 to be circumstances of emerging AGI. [25]
Characteristics
Various popular meanings of intelligence have actually been proposed. One of the leading propositions is the Turing test. However, there are other well-known meanings, and some researchers disagree with the more popular methods. [b]
Intelligence traits
Researchers generally hold that intelligence is needed to do all of the following: [27]
reason, usage technique, solve puzzles, and make judgments under unpredictability
represent understanding, including good sense understanding
plan
learn
- communicate in natural language
- if necessary, integrate these skills in conclusion of any offered objective
Many interdisciplinary methods (e.g. cognitive science, computational intelligence, and choice making) think about extra traits such as creativity (the capability to form novel mental images and concepts) [28] and autonomy. [29]
Computer-based systems that show much of these abilities exist (e.g. see computational imagination, automated thinking, decision assistance system, robot, evolutionary computation, intelligent agent). There is dispute about whether modern AI systems possess them to a sufficient degree.
Physical traits
Other abilities are considered preferable in smart systems, as they may impact intelligence or help in its expression. These include: [30]
- the ability to sense (e.g. see, hear, etc), and
- the ability to act (e.g. move and manipulate items, modification location to check out, etc).
This consists of the capability to spot and respond to risk. [31]
Although the capability to sense (e.g. see, hear, and so on) and the capability to act (e.g. relocation and manipulate things, change area to check out, and so on) can be preferable for some intelligent systems, [30] these physical capabilities are not strictly needed for an entity to qualify as AGI-particularly under the thesis that big language models (LLMs) might already be or end up being AGI. Even from a less positive viewpoint on LLMs, there is no company requirement for an AGI to have a human-like kind; being a silicon-based computational system suffices, offered it can process input (language) from the external world in place of human senses. This analysis aligns with the understanding that AGI has never been proscribed a specific physical personification and therefore does not require a capacity for mobility or conventional "eyes and ears". [32]
Tests for human-level AGI
Several tests suggested to validate human-level AGI have actually been thought about, consisting of: [33] [34]
The idea of the test is that the maker needs to attempt and pretend to be a man, by addressing questions put to it, and it will just pass if the pretence is reasonably persuading. A substantial part of a jury, who must not be expert about devices, need to be taken in by the pretence. [37]
AI-complete problems
A problem is informally called "AI-complete" or "AI-hard" if it is thought that in order to solve it, one would require to implement AGI, due to the fact that the option is beyond the abilities of a purpose-specific algorithm. [47]
There are many issues that have been conjectured to require basic intelligence to solve as well as humans. Examples consist of computer system vision, natural language understanding, and dealing with unforeseen situations while solving any real-world issue. [48] Even a specific task like translation requires a maker to read and write in both languages, follow the author's argument (factor), comprehend the context (understanding), and faithfully reproduce the author's original intent (social intelligence). All of these problems require to be resolved concurrently in order to reach human-level maker efficiency.
However, a lot of these jobs can now be performed by modern-day big language designs. According to Stanford University's 2024 AI index, AI has reached human-level efficiency on numerous standards for reading understanding and visual reasoning. [49]
History
Classical AI
Modern AI research study began in the mid-1950s. [50] The very first generation of AI scientists were encouraged that artificial basic intelligence was possible which it would exist in simply a couple of decades. [51] AI leader Herbert A. Simon wrote in 1965: "devices will be capable, within twenty years, of doing any work a man can do." [52]
Their predictions were the inspiration for Stanley Kubrick and Arthur C. Clarke's character HAL 9000, who embodied what AI scientists believed they might produce by the year 2001. AI pioneer Marvin Minsky was a specialist [53] on the project of making HAL 9000 as sensible as possible according to the agreement predictions of the time. He said in 1967, "Within a generation ... the problem of creating 'artificial intelligence' will considerably be resolved". [54]
Several classical AI projects, such as Doug Lenat's Cyc job (that started in 1984), and Allen Newell's Soar project, were directed at AGI.
However, in the early 1970s, it became obvious that researchers had actually grossly underestimated the problem of the job. Funding firms became skeptical of AGI and put scientists under increasing pressure to produce useful "used AI". [c] In the early 1980s, Japan's Fifth Generation Computer Project restored interest in AGI, setting out a ten-year timeline that included AGI objectives like "continue a casual conversation". [58] In reaction to this and the success of expert systems, both industry and government pumped money into the field. [56] [59] However, self-confidence in AI stunningly collapsed in the late 1980s, and the goals of the Fifth Generation Computer Project were never ever satisfied. [60] For the 2nd time in twenty years, AI researchers who anticipated the imminent accomplishment of AGI had actually been mistaken. By the 1990s, AI researchers had a reputation for making vain guarantees. They became reluctant to make predictions at all [d] and prevented reference of "human level" expert system for worry of being labeled "wild-eyed dreamer [s]. [62]
Narrow AI research
In the 1990s and early 21st century, mainstream AI attained business success and scholastic respectability by focusing on particular sub-problems where AI can produce verifiable results and business applications, such as speech recognition and recommendation algorithms. [63] These "applied AI" systems are now utilized extensively throughout the innovation industry, and research in this vein is heavily moneyed in both academic community and industry. As of 2018 [update], development in this field was considered an emerging trend, and a mature phase was expected to be reached in more than 10 years. [64]
At the turn of the century, many traditional AI scientists [65] hoped that strong AI could be established by combining programs that resolve numerous sub-problems. Hans Moravec composed in 1988:
I am positive that this bottom-up path to expert system will one day meet the traditional top-down route over half way, prepared to offer the real-world skills and the commonsense knowledge that has actually been so frustratingly evasive in reasoning programs. Fully smart devices will result when the metaphorical golden spike is driven joining the 2 efforts. [65]
However, even at the time, this was disputed. For example, Stevan Harnad of Princeton University concluded his 1990 paper on the sign grounding hypothesis by mentioning:
The expectation has actually often been voiced that "top-down" (symbolic) approaches to modeling cognition will in some way fulfill "bottom-up" (sensory) approaches someplace in between. If the grounding factors to consider in this paper are valid, then this expectation is hopelessly modular and there is truly just one viable route from sense to symbols: from the ground up. A free-floating symbolic level like the software application level of a computer system will never ever be reached by this path (or vice versa) - nor is it clear why we ought to even try to reach such a level, given that it appears getting there would simply amount to uprooting our signs from their intrinsic significances (thereby simply reducing ourselves to the practical equivalent of a programmable computer system). [66]
Modern artificial basic intelligence research study
The term "artificial general intelligence" was utilized as early as 1997, by Mark Gubrud [67] in a conversation of the ramifications of totally automated military production and operations. A mathematical formalism of AGI was proposed by Marcus Hutter in 2000. Named AIXI, the proposed AGI agent maximises "the capability to please goals in a wide variety of environments". [68] This type of AGI, defined by the ability to maximise a mathematical meaning of intelligence rather than show human-like behaviour, [69] was also called universal expert system. [70]
The term AGI was re-introduced and promoted by Shane Legg and Ben Goertzel around 2002. [71] AGI research activity in 2006 was described by Pei Wang and Ben Goertzel [72] as "producing publications and initial outcomes". The first summer season school in AGI was organized in Xiamen, China in 2009 [73] by the Xiamen university's Artificial Brain Laboratory and OpenCog. The first university course was given up 2010 [74] and 2011 [75] at Plovdiv University, Bulgaria by Todor Arnaudov. MIT provided a course on AGI in 2018, arranged by Lex Fridman and including a number of visitor speakers.
As of 2023 [upgrade], a little number of computer scientists are active in AGI research, and numerous contribute to a series of AGI conferences. However, significantly more researchers have an interest in open-ended knowing, [76] [77] which is the idea of permitting AI to continuously discover and innovate like people do.
Feasibility
As of 2023, the development and prospective achievement of AGI remains a subject of intense argument within the AI neighborhood. While conventional agreement held that AGI was a remote goal, recent improvements have actually led some scientists and market figures to claim that early kinds of AGI may currently exist. [78] AI pioneer Herbert A. Simon hypothesized in 1965 that "devices will be capable, within twenty years, of doing any work a guy can do". This prediction failed to come real. Microsoft co-founder Paul Allen thought that such intelligence is not likely in the 21st century since it would require "unforeseeable and essentially unforeseeable developments" and a "clinically deep understanding of cognition". [79] Writing in The Guardian, roboticist Alan Winfield declared the gulf in between modern-day computing and human-level synthetic intelligence is as broad as the gulf in between existing space flight and practical faster-than-light spaceflight. [80]
A more challenge is the lack of clearness in defining what intelligence involves. Does it need awareness? Must it display the ability to set objectives as well as pursue them? Is it purely a matter of scale such that if design sizes increase adequately, intelligence will emerge? Are facilities such as preparation, thinking, and causal understanding needed? Does intelligence need explicitly reproducing the brain and its specific professors? Does it require feelings? [81]
Most AI researchers think strong AI can be attained in the future, but some thinkers, like Hubert Dreyfus and Roger Penrose, deny the possibility of attaining strong AI. [82] [83] John McCarthy is among those who think human-level AI will be achieved, but that the present level of development is such that a date can not precisely be predicted. [84] AI experts' views on the feasibility of AGI wax and wane. Four surveys conducted in 2012 and 2013 suggested that the median estimate amongst experts for when they would be 50% positive AGI would get here was 2040 to 2050, depending upon the survey, with the mean being 2081. Of the specialists, 16.5% addressed with "never" when asked the same concern but with a 90% confidence instead. [85] [86] Further present AGI progress considerations can be discovered above Tests for validating human-level AGI.
A report by Stuart Armstrong and Kaj Sotala of the Machine Intelligence Research Institute discovered that "over [a] 60-year time frame there is a strong predisposition towards forecasting the arrival of human-level AI as in between 15 and 25 years from the time the prediction was made". They evaluated 95 forecasts made between 1950 and 2012 on when human-level AI will come about. [87]
In 2023, Microsoft scientists released an in-depth assessment of GPT-4. They concluded: "Given the breadth and depth of GPT-4's capabilities, we believe that it might reasonably be deemed an early (yet still insufficient) variation of an artificial basic intelligence (AGI) system." [88] Another study in 2023 reported that GPT-4 surpasses 99% of humans on the Torrance tests of creative thinking. [89] [90]
Blaise Agüera y Arcas and Peter Norvig composed in 2023 that a considerable level of general intelligence has currently been achieved with frontier designs. They wrote that hesitation to this view originates from four primary reasons: a "healthy skepticism about metrics for AGI", an "ideological dedication to alternative AI theories or techniques", a "commitment to human (or biological) exceptionalism", or a "issue about the economic ramifications of AGI". [91]
2023 likewise marked the development of big multimodal models (big language designs capable of processing or creating multiple methods such as text, audio, and images). [92]
In 2024, OpenAI launched o1-preview, the first of a series of models that "spend more time believing before they react". According to Mira Murati, this capability to think before responding represents a new, additional paradigm. It enhances model outputs by spending more computing power when creating the answer, whereas the model scaling paradigm enhances outputs by increasing the model size, training information and training calculate power. [93] [94]
An OpenAI employee, Vahid Kazemi, claimed in 2024 that the business had accomplished AGI, stating, "In my opinion, we have actually currently attained AGI and it's a lot more clear with O1." Kazemi clarified that while the AI is not yet "better than any human at any job", it is "much better than most humans at many jobs." He likewise addressed criticisms that big language designs (LLMs) merely follow predefined patterns, comparing their knowing procedure to the scientific method of observing, hypothesizing, and verifying. These statements have triggered dispute, as they count on a broad and non-traditional definition of AGI-traditionally comprehended as AI that matches human intelligence throughout all domains. Critics argue that, while OpenAI's models demonstrate exceptional adaptability, they might not totally meet this requirement. Notably, Kazemi's remarks came shortly after OpenAI removed "AGI" from the terms of its partnership with Microsoft, triggering speculation about the business's tactical objectives. [95]
Timescales
Progress in artificial intelligence has actually historically gone through durations of fast development separated by durations when development appeared to stop. [82] Ending each hiatus were essential advances in hardware, software application or both to develop area for further progress. [82] [98] [99] For instance, the hardware readily available in the twentieth century was not adequate to execute deep knowing, which requires big numbers of GPU-enabled CPUs. [100]
In the intro to his 2006 book, [101] Goertzel says that estimates of the time needed before a truly flexible AGI is constructed vary from 10 years to over a century. Since 2007 [upgrade], the consensus in the AGI research study neighborhood seemed to be that the timeline talked about by Ray Kurzweil in 2005 in The Singularity is Near [102] (i.e. in between 2015 and 2045) was possible. [103] Mainstream AI scientists have actually provided a wide variety of viewpoints on whether development will be this quick. A 2012 meta-analysis of 95 such opinions discovered a predisposition towards forecasting that the onset of AGI would happen within 16-26 years for modern-day and historical predictions alike. That paper has been criticized for how it classified viewpoints as specialist or non-expert. [104]
In 2012, Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton developed a neural network called AlexNet, which won the ImageNet competitors with a top-5 test mistake rate of 15.3%, substantially better than the second-best entry's rate of 26.3% (the traditional method used a weighted sum of ratings from different pre-defined classifiers). [105] AlexNet was considered as the preliminary ground-breaker of the current deep knowing wave. [105]
In 2017, scientists Feng Liu, Yong Shi, and Ying Liu performed intelligence tests on openly available and freely accessible weak AI such as Google AI, Apple's Siri, and others. At the optimum, these AIs reached an IQ worth of about 47, which corresponds roughly to a six-year-old child in very first grade. A grownup comes to about 100 on average. Similar tests were brought out in 2014, with the IQ rating reaching an optimum worth of 27. [106] [107]
In 2020, OpenAI developed GPT-3, a language model capable of performing many diverse jobs without specific training. According to Gary Grossman in a VentureBeat post, while there is agreement that GPT-3 is not an example of AGI, it is thought about by some to be too advanced to be classified as a narrow AI system. [108]
In the very same year, Jason Rohrer used his GPT-3 account to develop a chatbot, and supplied a chatbot-developing platform called "Project December". OpenAI requested for modifications to the chatbot to adhere to their security standards; Rohrer detached Project December from the GPT-3 API. [109]
In 2022, DeepMind established Gato, a "general-purpose" system capable of carrying out more than 600 various tasks. [110]
In 2023, Microsoft Research released a study on an early variation of OpenAI's GPT-4, contending that it showed more basic intelligence than previous AI models and showed human-level efficiency in jobs covering numerous domains, such as mathematics, coding, and law. This research triggered a dispute on whether GPT-4 might be thought about an early, incomplete variation of synthetic basic intelligence, highlighting the requirement for further expedition and assessment of such systems. [111]
In 2023, the AI scientist Geoffrey Hinton stated that: [112]
The concept that this stuff could in fact get smarter than individuals - a few people thought that, [...] But many people thought it was way off. And I thought it was way off. I believed it was 30 to 50 years or perhaps longer away. Obviously, I no longer believe that.
In May 2023, Demis Hassabis similarly said that "The progress in the last few years has actually been pretty extraordinary", which he sees no reason why it would slow down, expecting AGI within a decade or even a few years. [113] In March 2024, Nvidia's CEO, Jensen Huang, mentioned his expectation that within 5 years, AI would be capable of passing any test a minimum of in addition to people. [114] In June 2024, the AI researcher Leopold Aschenbrenner, a former OpenAI employee, approximated AGI by 2027 to be "strikingly possible". [115]
Whole brain emulation
While the advancement of transformer models like in ChatGPT is thought about the most appealing course to AGI, [116] [117] whole brain emulation can function as an alternative approach. With entire brain simulation, a brain model is developed by scanning and mapping a biological brain in information, and after that copying and replicating it on a computer system or another computational gadget. The simulation design need to be sufficiently faithful to the original, so that it behaves in practically the very same method as the initial brain. [118] Whole brain emulation is a type of brain simulation that is discussed in computational neuroscience and neuroinformatics, and for medical research functions. It has been discussed in synthetic intelligence research study [103] as a technique to strong AI. Neuroimaging innovations that could deliver the required detailed understanding are enhancing rapidly, and futurist Ray Kurzweil in the book The Singularity Is Near [102] forecasts that a map of sufficient quality will appear on a comparable timescale to the computing power required to imitate it.
Early estimates
For low-level brain simulation, a really effective cluster of computers or GPUs would be needed, given the huge amount of synapses within the human brain. Each of the 1011 (one hundred billion) neurons has on average 7,000 synaptic connections (synapses) to other nerve cells. The brain of a three-year-old child has about 1015 synapses (1 quadrillion). This number decreases with age, supporting by their adult years. Estimates vary for an adult, ranging from 1014 to 5 × 1014 synapses (100 to 500 trillion). [120] A price quote of the brain's processing power, based upon a simple switch design for nerve cell activity, is around 1014 (100 trillion) synaptic updates per second (SUPS). [121]
In 1997, Kurzweil looked at numerous price quotes for the hardware required to equate to the human brain and adopted a figure of 1016 calculations per second (cps). [e] (For comparison, if a "calculation" was comparable to one "floating-point operation" - a measure utilized to rate present supercomputers - then 1016 "computations" would be comparable to 10 petaFLOPS, achieved in 2011, while 1018 was attained in 2022.) He used this figure to predict the essential hardware would be available sometime in between 2015 and 2025, if the rapid growth in computer power at the time of composing continued.
Current research study
The Human Brain Project, an EU-funded effort active from 2013 to 2023, has actually established an especially detailed and openly available atlas of the human brain. [124] In 2023, researchers from Duke University performed a high-resolution scan of a mouse brain.
Criticisms of simulation-based methods
The artificial neuron model presumed by Kurzweil and used in numerous current artificial neural network executions is simple compared to biological neurons. A brain simulation would likely need to capture the detailed cellular behaviour of biological neurons, currently comprehended just in broad summary. The overhead introduced by complete modeling of the biological, chemical, and physical information of neural behaviour (especially on a molecular scale) would need computational powers a number of orders of magnitude larger than Kurzweil's estimate. In addition, the quotes do not represent glial cells, which are known to play a role in cognitive procedures. [125]
An essential criticism of the simulated brain technique originates from embodied cognition theory which asserts that human embodiment is an important element of human intelligence and is essential to ground meaning. [126] [127] If this theory is correct, any totally practical brain model will need to encompass more than simply the nerve cells (e.g., a robotic body). Goertzel [103] proposes virtual personification (like in metaverses like Second Life) as an option, but it is unknown whether this would be sufficient.
Philosophical viewpoint
"Strong AI" as defined in approach
In 1980, thinker John Searle coined the term "strong AI" as part of his Chinese space argument. [128] He proposed a distinction in between 2 hypotheses about expert system: [f]
Strong AI hypothesis: An artificial intelligence system can have "a mind" and "awareness".
Weak AI hypothesis: A synthetic intelligence system can (just) imitate it thinks and has a mind and awareness.
The first one he called "strong" due to the fact that it makes a more powerful declaration: it assumes something special has actually occurred to the machine that goes beyond those abilities that we can check. The behaviour of a "weak AI" device would be specifically identical to a "strong AI" maker, but the latter would also have subjective conscious experience. This use is likewise common in scholastic AI research and textbooks. [129]
In contrast to Searle and traditional AI, some futurists such as Ray Kurzweil utilize the term "strong AI" to mean "human level synthetic basic intelligence". [102] This is not the very same as Searle's strong AI, unless it is assumed that awareness is needed for human-level AGI. Academic thinkers such as Searle do not believe that is the case, and to most synthetic intelligence scientists the concern is out-of-scope. [130]
Mainstream AI is most thinking about how a program acts. [131] According to Russell and Norvig, "as long as the program works, they do not care if you call it real or a simulation." [130] If the program can act as if it has a mind, then there is no need to understand if it actually has mind - undoubtedly, there would be no other way to inform. For AI research study, Searle's "weak AI hypothesis" is equivalent to the statement "artificial general intelligence is possible". Thus, according to Russell and Norvig, "most AI researchers take the weak AI hypothesis for given, and do not care about the strong AI hypothesis." [130] Thus, for scholastic AI research, "Strong AI" and "AGI" are two various things.
Consciousness
Consciousness can have numerous significances, and some aspects play considerable functions in science fiction and the ethics of artificial intelligence:
Sentience (or "incredible consciousness"): The capability to "feel" perceptions or emotions subjectively, as opposed to the capability to reason about understandings. Some thinkers, such as David Chalmers, use the term "consciousness" to refer specifically to phenomenal awareness, which is roughly equivalent to life. [132] Determining why and how subjective experience emerges is understood as the tough issue of awareness. [133] Thomas Nagel explained in 1974 that it "seems like" something to be mindful. If we are not conscious, then it does not seem like anything. Nagel uses the example of a bat: we can sensibly ask "what does it seem like to be a bat?" However, we are not likely to ask "what does it seem like to be a toaster?" Nagel concludes that a bat seems conscious (i.e., has awareness) but a toaster does not. [134] In 2022, a Google engineer declared that the company's AI chatbot, LaMDA, had achieved life, though this claim was widely challenged by other specialists. [135]
Self-awareness: To have mindful awareness of oneself as a different individual, specifically to be purposely familiar with one's own thoughts. This is opposed to just being the "subject of one's believed"-an operating system or debugger has the ability to be "aware of itself" (that is, to represent itself in the very same method it represents whatever else)-but this is not what people typically suggest when they use the term "self-awareness". [g]
These qualities have an ethical measurement. AI sentience would trigger issues of well-being and legal protection, similarly to animals. [136] Other elements of consciousness associated to cognitive capabilities are likewise pertinent to the idea of AI rights. [137] Determining how to integrate advanced AI with existing legal and social frameworks is an emerging problem. [138]
Benefits
AGI could have a broad variety of applications. If oriented towards such objectives, AGI might help alleviate different issues in the world such as cravings, poverty and health issues. [139]
AGI might improve performance and effectiveness in the majority of tasks. For instance, in public health, AGI might accelerate medical research study, significantly against cancer. [140] It might look after the senior, [141] and democratize access to quick, premium medical diagnostics. It could offer fun, low-cost and personalized education. [141] The requirement to work to subsist could become obsolete if the wealth produced is appropriately rearranged. [141] [142] This also raises the concern of the location of people in a radically automated society.
AGI could also assist to make rational decisions, and to prepare for and avoid catastrophes. It might likewise assist to reap the advantages of potentially catastrophic technologies such as nanotechnology or climate engineering, while preventing the associated risks. [143] If an AGI's main goal is to avoid existential disasters such as human termination (which might be difficult if the Vulnerable World Hypothesis turns out to be real), [144] it could take procedures to considerably lower the threats [143] while decreasing the impact of these steps on our lifestyle.
Risks
Existential dangers
AGI may represent multiple types of existential risk, which are threats that threaten "the premature extinction of Earth-originating intelligent life or the permanent and extreme damage of its potential for preferable future development". [145] The danger of human termination from AGI has actually been the subject of numerous debates, however there is also the possibility that the development of AGI would result in a permanently flawed future. Notably, it might be utilized to spread out and preserve the set of values of whoever develops it. If humanity still has ethical blind areas similar to slavery in the past, AGI may irreversibly entrench it, avoiding moral development. [146] Furthermore, AGI could assist in mass monitoring and indoctrination, which might be utilized to produce a stable repressive around the world totalitarian program. [147] [148] There is likewise a danger for the makers themselves. If machines that are sentient or otherwise deserving of ethical factor to consider are mass created in the future, taking part in a civilizational course that forever ignores their well-being and interests could be an existential disaster. [149] [150] Considering just how much AGI might improve humanity's future and help in reducing other existential risks, Toby Ord calls these existential risks "an argument for proceeding with due caution", not for "deserting AI". [147]
Risk of loss of control and human termination
The thesis that AI poses an existential danger for human beings, and that this threat requires more attention, is questionable but has been backed in 2023 by numerous public figures, AI researchers and CEOs of AI companies such as Elon Musk, Bill Gates, Geoffrey Hinton, Yoshua Bengio, Demis Hassabis and Sam Altman. [151] [152]
In 2014, Stephen Hawking criticized extensive indifference:
So, facing possible futures of enormous advantages and risks, the experts are undoubtedly doing everything possible to make sure the very best outcome, right? Wrong. If a remarkable alien civilisation sent us a message stating, 'We'll show up in a few years,' would we simply respond, 'OK, call us when you get here-we'll leave the lights on?' Probably not-but this is basically what is occurring with AI. [153]
The prospective fate of humankind has sometimes been compared to the fate of gorillas threatened by human activities. The comparison states that higher intelligence permitted mankind to dominate gorillas, which are now vulnerable in manner ins which they might not have actually anticipated. As an outcome, the gorilla has become a threatened types, not out of malice, however just as a collateral damage from human activities. [154]
The skeptic Yann LeCun thinks about that AGIs will have no desire to dominate humanity which we must beware not to anthropomorphize them and interpret their intents as we would for humans. He said that people will not be "smart adequate to create super-intelligent devices, yet unbelievably foolish to the point of providing it moronic goals with no safeguards". [155] On the other side, the principle of critical merging recommends that almost whatever their objectives, intelligent representatives will have factors to attempt to endure and get more power as intermediary actions to achieving these goals. And that this does not require having feelings. [156]
Many scholars who are concerned about existential risk supporter for more research into solving the "control problem" to answer the concern: what kinds of safeguards, algorithms, or architectures can programmers execute to maximise the likelihood that their recursively-improving AI would continue to behave in a friendly, instead of devastating, manner after it reaches superintelligence? [157] [158] Solving the control issue is complicated by the AI arms race (which might result in a race to the bottom of security preventative measures in order to release items before competitors), [159] and making use of AI in weapon systems. [160]
The thesis that AI can present existential threat likewise has detractors. Skeptics usually say that AGI is unlikely in the short-term, or that issues about AGI distract from other issues connected to present AI. [161] Former Google fraud czar Shuman Ghosemajumder thinks about that for lots of individuals outside of the innovation market, existing chatbots and LLMs are currently viewed as though they were AGI, causing further misconception and fear. [162]
Skeptics in some cases charge that the thesis is crypto-religious, with an illogical belief in the possibility of superintelligence replacing an irrational belief in a supreme God. [163] Some scientists think that the interaction campaigns on AI existential risk by specific AI groups (such as OpenAI, Anthropic, DeepMind, and Conjecture) might be an at effort at regulative capture and to pump up interest in their products. [164] [165]
In 2023, the CEOs of Google DeepMind, OpenAI and Anthropic, along with other market leaders and researchers, issued a joint declaration asserting that "Mitigating the threat of extinction from AI need to be a worldwide concern alongside other societal-scale risks such as pandemics and nuclear war." [152]
Mass unemployment
Researchers from OpenAI approximated that "80% of the U.S. labor force might have at least 10% of their work tasks impacted by the intro of LLMs, while around 19% of workers may see at least 50% of their tasks impacted". [166] [167] They consider office workers to be the most exposed, for example mathematicians, accounting professionals or web designers. [167] AGI could have a better autonomy, capability to make choices, to interface with other computer tools, however likewise to manage robotized bodies.
According to Stephen Hawking, the outcome of automation on the quality of life will depend on how the wealth will be redistributed: [142]
Everyone can enjoy a life of elegant leisure if the machine-produced wealth is shared, or the majority of people can end up badly poor if the machine-owners effectively lobby versus wealth redistribution. Up until now, the trend appears to be toward the second option, with innovation driving ever-increasing inequality
Elon Musk thinks about that the automation of society will need federal governments to embrace a universal fundamental earnings. [168]
See also
Artificial brain - Software and hardware with cognitive abilities comparable to those of the animal or human brain
AI impact
AI security - Research area on making AI safe and beneficial
AI positioning - AI conformance to the desired objective
A.I. Rising - 2018 movie directed by Lazar Bodroža
Artificial intelligence
Automated artificial intelligence - Process of automating the application of artificial intelligence
BRAIN Initiative - Collaborative public-private research study effort revealed by the Obama administration
China Brain Project
Future of Humanity Institute - Defunct Oxford interdisciplinary research centre
General video game playing - Ability of synthetic intelligence to play various games
Generative artificial intelligence - AI system capable of producing content in action to prompts
Human Brain Project - Scientific research project
Intelligence amplification - Use of infotech to augment human intelligence (IA).
Machine ethics - Moral behaviours of manufactured machines.
Moravec's paradox.
Multi-task knowing - Solving numerous machine discovering jobs at the same time.
Neural scaling law - Statistical law in artificial intelligence.
Outline of expert system - Overview of and topical guide to artificial intelligence.
Transhumanism - Philosophical movement.
Synthetic intelligence - Alternate term for or type of artificial intelligence.
Transfer learning - Artificial intelligence strategy.
Loebner Prize - Annual AI competitors.
Hardware for expert system - Hardware specifically created and enhanced for expert system.
Weak expert system - Form of synthetic intelligence.
Notes
^ a b See listed below for the origin of the term "strong AI", and see the scholastic meaning of "strong AI" and weak AI in the article Chinese room.
^ AI creator John McCarthy writes: "we can not yet define in general what sort of computational treatments we wish to call intelligent. " [26] (For a conversation of some definitions of intelligence utilized by artificial intelligence scientists, see approach of artificial intelligence.).
^ The Lighthill report specifically slammed AI's "grandiose objectives" and led the dismantling of AI research study in England. [55] In the U.S., DARPA ended up being identified to money just "mission-oriented direct research, rather than fundamental undirected research". [56] [57] ^ As AI founder John McCarthy composes "it would be a fantastic relief to the remainder of the workers in AI if the creators of new basic formalisms would express their hopes in a more guarded type than has actually in some cases held true." [61] ^ In "Mind Children" [122] 1015 cps is used. More recently, in 1997, [123] Moravec argued for 108 MIPS which would roughly represent 1014 cps. Moravec talks in terms of MIPS, not "cps", which is a non-standard term Kurzweil introduced.
^ As specified in a basic AI textbook: "The assertion that makers might possibly act wisely (or, perhaps much better, act as if they were smart) is called the 'weak AI' hypothesis by theorists, and the assertion that makers that do so are in fact believing (rather than imitating thinking) is called the 'strong AI' hypothesis." [121] ^ Alan Turing made this point in 1950. [36] References
^ Krishna, Sri (9 February 2023). "What is artificial narrow intelligence (ANI)?". VentureBeat. Retrieved 1 March 2024. ANI is designed to perform a single job.
^ "OpenAI Charter". OpenAI. Retrieved 6 April 2023. Our objective is to make sure that artificial general intelligence benefits all of humanity.
^ Heath, Alex (18 January 2024). "Mark Zuckerberg's brand-new goal is developing synthetic basic intelligence". The Verge. Retrieved 13 June 2024. Our vision is to build AI that is much better than human-level at all of the human senses.
^ Baum, Seth D. (2020 ). A Survey of Artificial General Intelligence Projects for Ethics, Risk, and Policy (PDF) (Report). Global Catastrophic Risk Institute. Retrieved 28 November 2024. 72 AGI R&D projects were identified as being active in 2020.
^ a b c "AI timelines: What do experts in synthetic intelligence anticipate for the future?". Our World in Data. Retrieved 6 April 2023.
^ Metz, Cade (15 May 2023). "Some Researchers Say A.I. Is Already Here, Stirring Debate in Tech Circles". The New York Times. Retrieved 18 May 2023.
^ "AI pioneer Geoffrey Hinton quits Google and warns of risk ahead". The New York Times. 1 May 2023. Retrieved 2 May 2023. It is tough to see how you can avoid the bad actors from utilizing it for bad things.
^ Bubeck, Sébastien; Chandrasekaran, Varun; Eldan, Ronen; Gehrke, Johannes; Horvitz, Eric (2023 ). "Sparks of Artificial General Intelligence: Early explores GPT-4". arXiv preprint. arXiv:2303.12712. GPT-4 shows triggers of AGI.
^ Butler, Octavia E. (1993 ). Parable of the Sower. Grand Central Publishing. ISBN 978-0-4466-7550-5. All that you touch you change. All that you alter changes you.
^ Vinge, Vernor (1992 ). A Fire Upon the Deep. Tor Books. ISBN 978-0-8125-1528-2. The Singularity is coming.
^ Morozov, Evgeny (30 June 2023). "The True Threat of Artificial Intelligence". The New York City Times. The real threat is not AI itself however the method we release it.
^ "Impressed by expert system? Experts state AGI is coming next, and it has 'existential' threats". ABC News. 23 March 2023. Retrieved 6 April 2023. AGI might posture existential risks to humankind.
^ Bostrom, Nick (2014 ). Superintelligence: Paths, Dangers, Strategies. Oxford University Press. ISBN 978-0-1996-7811-2. The very first superintelligence will be the last development that humanity needs to make.
^ Roose, Kevin (30 May 2023). "A.I. Poses 'Risk of Extinction,' Industry Leaders Warn". The New York Times. Mitigating the danger of termination from AI must be a global priority.
^ "Statement on AI Risk". Center for AI Safety. Retrieved 1 March 2024. AI specialists warn of threat of extinction from AI.
^ Mitchell, Melanie (30 May 2023). "Are AI's Doomsday Scenarios Worth Taking Seriously?". The New York Times. We are far from developing makers that can outthink us in general ways.
^ LeCun, Yann (June 2023). "AGI does not provide an existential danger". Medium. There is no reason to fear AI as an existential threat.
^ Kurzweil 2005, p. 260.
^ a b Kurzweil, Ray (5 August 2005), "Long Live AI", Forbes, archived from the initial on 14 August 2005: Kurzweil describes strong AI as "machine intelligence with the full variety of human intelligence.".
^ "The Age of Expert System: George John at TEDxLondonBusinessSchool 2013". Archived from the initial on 26 February 2014. Retrieved 22 February 2014.
^ Newell & Simon 1976, This is the term they use for "human-level" intelligence in the physical symbol system hypothesis.
^ "The Open University on Strong and Weak AI". Archived from the initial on 25 September 2009. Retrieved 8 October 2007.
^ "What is synthetic superintelligence (ASI)?|Definition from TechTarget". Enterprise AI. Retrieved 8 October 2023.
^ "Expert system is transforming our world - it is on all of us to make certain that it works out". Our World in Data. Retrieved 8 October 2023.
^ Dickson, Ben (16 November 2023). "Here is how far we are to attaining AGI, according to DeepMind". VentureBeat.
^ McCarthy, John (2007a). "Basic Questions". Stanford University. Archived from the initial on 26 October 2007. Retrieved 6 December 2007.
^ This list of intelligent characteristics is based upon the subjects covered by significant AI textbooks, consisting of: Russell & Norvig 2003, Luger & Stubblefield 2004, Poole, Mackworth & Goebel 1998 and Nilsson 1998.
^ Johnson 1987.
^ de Charms, R. (1968 ). Personal causation. New York City: Academic Press.
^ a b Pfeifer, R. and Bongard J. C., How the body forms the way we think: a new view of intelligence (The MIT Press, 2007). ISBN 0-2621-6239-3.
^ White, R. W. (1959 ). "Motivation reconsidered: The idea of proficiency". Psychological Review. 66 (5 ): 297-333. doi:10.1037/ h0040934. PMID 13844397. S2CID 37385966.
^ White, R. W. (1959 ). "Motivation reevaluated: The concept of skills". Psychological Review. 66 (5 ): 297-333. doi:10.1037/ h0040934. PMID 13844397. S2CID 37385966.
^ Muehlhauser, Luke (11 August 2013). "What is AGI?". Machine Intelligence Research Institute. Archived from the original on 25 April 2014. Retrieved 1 May 2014.
^ "What is Artificial General Intelligence (AGI)?|4 Tests For Ensuring Artificial General Intelligence". Talky Blog. 13 July 2019. Archived from the original on 17 July 2019. Retrieved 17 July 2019.
^ Kirk-Giannini, Cameron Domenico; Goldstein, Simon (16 October 2023). "AI is closer than ever to passing the Turing test for 'intelligence'. What happens when it does?". The Conversation. Retrieved 22 September 2024.
^ a b Turing 1950.
^ Turing, Alan (1952 ). B. Jack Copeland (ed.). Can Automatic Calculating Machines Be Said To Think?. Oxford: Oxford University Press. pp. 487-506. ISBN 978-0-1982-5079-1.
^ "Eugene Goostman is a genuine boy - the Turing Test says so". The Guardian. 9 June 2014. ISSN 0261-3077. Retrieved 3 March 2024.
^ "Scientists contest whether computer system 'Eugene Goostman' passed Turing test". BBC News. 9 June 2014. Retrieved 3 March 2024.
^ Jones, Cameron R.; Bergen, Benjamin K. (9 May 2024). "People can not differentiate GPT-4 from a human in a Turing test". arXiv:2405.08007 [cs.HC]
^ Varanasi, Lakshmi (21 March 2023). "AI designs like ChatGPT and GPT-4 are acing whatever from the bar test to AP Biology. Here's a list of difficult exams both AI variations have actually passed". Business Insider. Retrieved 30 May 2023.
^ Naysmith, Caleb (7 February 2023). "6 Jobs Artificial Intelligence Is Already Replacing and How Investors Can Capitalize on It". Retrieved 30 May 2023.
^ Turk, Victoria (28 January 2015). "The Plan to Replace the Turing Test with a 'Turing Olympics'". Vice. Retrieved 3 March 2024.
^ Gopani, Avi (25 May 2022). "Turing Test is undependable. The Winograd Schema is obsolete. Coffee is the response". Analytics India Magazine. Retrieved 3 March 2024.
^ Bhaimiya, Sawdah (20 June 2023). "DeepMind's co-founder recommended checking an AI chatbot's capability to turn $100,000 into $1 million to measure human-like intelligence". Business Insider. Retrieved 3 March 2024.
^ Suleyman, Mustafa (14 July 2023). "Mustafa Suleyman: My new Turing test would see if AI can make $1 million". MIT Technology Review. Retrieved 3 March 2024.
^ Shapiro, Stuart C. (1992 ). "Artificial Intelligence" (PDF). In Stuart C. Shapiro (ed.). Encyclopedia of Artificial Intelligence (Second ed.). New York City: John Wiley. pp. 54-57. Archived (PDF) from the original on 1 February 2016. (Section 4 is on "AI-Complete Tasks".).
^ Yampolskiy, Roman V. (2012 ). Xin-She Yang (ed.). "Turing Test as a Specifying Feature of AI-Completeness" (PDF). Artificial Intelligence, Evolutionary Computation and Metaheuristics (AIECM): 3-17. Archived (PDF) from the original on 22 May 2013.
^ "AI Index: State of AI in 13 Charts". Stanford University Human-Centered Artificial Intelligence. 15 April 2024. Retrieved 27 May 2024.
^ Crevier 1993, pp. 48-50.
^ Kaplan, Andreas (2022 ). "Expert System, Business and Civilization - Our Fate Made in Machines". Archived from the initial on 6 May 2022. Retrieved 12 March 2022.
^ Simon 1965, p. 96 estimated in Crevier 1993, p. 109.
^ "Scientist on the Set: An Interview with Marvin Minsky". Archived from the initial on 16 July 2012. Retrieved 5 April 2008.
^ Marvin Minsky to Darrach (1970 ), priced estimate in Crevier (1993, p. 109).
^ Lighthill 1973; Howe 1994.
^ a b NRC 1999, "Shift to Applied Research Increases Investment".
^ Crevier 1993, pp. 115-117; Russell & Norvig 2003, pp. 21-22.
^ Crevier 1993, p. 211, Russell & Norvig 2003, p. 24 and see likewise Feigenbaum & McCorduck 1983.
^ Crevier 1993, pp. 161-162, 197-203, 240; Russell & Norvig 2003, p. 25.
^ Crevier 1993, pp. 209-212.
^ McCarthy, John (2000 ). "Respond to Lighthill". Stanford University. Archived from the initial on 30 September 2008. Retrieved 29 September 2007.
^ Markoff, John (14 October 2005). "Behind Artificial Intelligence, a Squadron of Bright Real People". The New York City Times. Archived from the original on 2 February 2023. Retrieved 18 February 2017. At its low point, some computer scientists and software engineers avoided the term artificial intelligence for fear of being considered as wild-eyed dreamers.
^ Russell & Norvig 2003, pp. 25-26
^ "Trends in the Emerging Tech Hype Cycle". Gartner Reports. Archived from the initial on 22 May 2019. Retrieved 7 May 2019.
^ a b Moravec 1988, p. 20
^ Harnad, S. (1990 ). "The Symbol Grounding Problem". Physica D. 42 (1-3): 335-346. arXiv: cs/9906002. Bibcode:1990 PhyD ... 42..335 H. doi:10.1016/ 0167-2789( 90 )90087-6. S2CID 3204300.
^ Gubrud 1997
^ Hutter, Marcus (2005 ). Universal Expert System: Sequential Decisions Based Upon Algorithmic Probability. Texts in Theoretical Computer Science an EATCS Series. Springer. doi:10.1007/ b138233. ISBN 978-3-5402-6877-2. S2CID 33352850. Archived from the original on 19 July 2022. Retrieved 19 July 2022.
^ Legg, Shane (2008 ). Machine Super Intelligence (PDF) (Thesis). University of Lugano. Archived (PDF) from the original on 15 June 2022. Retrieved 19 July 2022.
^ Goertzel, Ben (2014 ). Artificial General Intelligence. Lecture Notes in Computer Science. Vol. 8598. Journal of Artificial General Intelligence. doi:10.1007/ 978-3-319-09274-4. ISBN 978-3-3190-9273-7. S2CID 8387410.
^ "Who created the term "AGI"?". goertzel.org. Archived from the initial on 28 December 2018. Retrieved 28 December 2018., by means of Life 3.0: 'The term "AGI" was promoted by ... Shane Legg, Mark Gubrud and Ben Goertzel'
^ Wang & Goertzel 2007
^ "First International Summer School in Artificial General Intelligence, Main summer school: June 22 - July 3, passfun.awardspace.us 2009, OpenCog Lab: July 6-9, 2009". Archived from the original on 28 September 2020. Retrieved 11 May 2020.
^ "Избираеми дисциплини 2009/2010 - пролетен триместър" [Elective courses 2009/2010 - spring trimester] Факултет по математика и информатика [Faculty of Mathematics and Informatics] (in Bulgarian). Archived from the initial on 26 July 2020. Retrieved 11 May 2020.
^ "Избираеми дисциплини 2010/2011 - зимен триместър" [Elective courses 2010/2011 - winter season trimester] Факултет по математика и информатика [Faculty of Mathematics and Informatics] (in Bulgarian). Archived from the original on 26 July 2020. Retrieved 11 May 2020.
^ Shevlin, Henry; Vold, Karina; Crosby, Matthew; Halina, Marta (4 October 2019). "The limits of device intelligence: Despite progress in machine intelligence, synthetic general intelligence is still a significant difficulty". EMBO Reports. 20 (10 ): e49177. doi:10.15252/ embr.201949177. ISSN 1469-221X. PMC 6776890. PMID 31531926.
^ Bubeck, Sébastien; Chandrasekaran, Varun; Eldan, Ronen; Gehrke, Johannes; Horvitz, Eric; Kamar, Ece; Lee, Peter; Lee, Yin Tat; Li, Yuanzhi; Lundberg, Scott; Nori, Harsha; Palangi, Hamid; Ribeiro, Marco Tulio; Zhang, Yi (27 March 2023). "Sparks of Artificial General Intelligence: Early experiments with GPT-4". arXiv:2303.12712 [cs.CL]
^ "Microsoft Researchers Claim GPT-4 Is Showing "Sparks" of AGI". Futurism. 23 March 2023. Retrieved 13 December 2023.
^ Allen, Paul; Greaves, Mark (12 October 2011). "The Singularity Isn't Near". MIT Technology Review. Retrieved 17 September 2014.
^ Winfield, Alan. "Expert system will not turn into a Frankenstein's monster". The Guardian. Archived from the initial on 17 September 2014. Retrieved 17 September 2014.
^ Deane, George (2022 ). "Machines That Feel and Think: The Role of Affective Feelings and Mental Action in (Artificial) General Intelligence". Artificial Life. 28 (3 ): 289-309. doi:10.1162/ artl_a_00368. ISSN 1064-5462. PMID 35881678. S2CID 251069071.
^ a b c Clocksin 2003.
^ Fjelland, Ragnar (17 June 2020). "Why basic synthetic intelligence will not be understood". Humanities and Social Sciences Communications. 7 (1 ): 1-9. doi:10.1057/ s41599-020-0494-4. hdl:11250/ 2726984. ISSN 2662-9992. S2CID 219710554.
^ McCarthy 2007b.
^ Khatchadourian, Raffi (23 November 2015). "The Doomsday Invention: Will expert system bring us paradise or damage?". The New Yorker. Archived from the original on 28 January 2016. Retrieved 7 February 2016.
^ Müller, V. C., & Bostrom, N. (2016 ). Future development in synthetic intelligence: A study of professional opinion. In Fundamental concerns of expert system (pp. 555-572). Springer, Cham.
^ Armstrong, Stuart, and Kaj Sotala. 2012. "How We're Predicting AI-or Failing To." In Beyond AI: Artificial Dreams, modified by Jan Romportl, Pavel Ircing, Eva Žáčková, Michal Polák and Radek Schuster, 52-75. Plzeň: University of West Bohemia
^ "Microsoft Now Claims GPT-4 Shows 'Sparks' of General Intelligence". 24 March 2023.
^ Shimek, Cary (6 July 2023). "AI Outperforms Humans in Creativity Test". Neuroscience News. Retrieved 20 October 2023.
^ Guzik, Erik E.; Byrge, Christian; Gilde, Christian (1 December 2023). "The originality of devices: AI takes the Torrance Test". Journal of Creativity. 33 (3 ): 100065. doi:10.1016/ j.yjoc.2023.100065. ISSN 2713-3745. S2CID 261087185.
^ Arcas, Blaise Agüera y (10 October 2023). "Artificial General Intelligence Is Already Here". Noema.
^ Zia, Tehseen (8 January 2024). "Unveiling of Large Multimodal Models: Shaping the Landscape of Language Models in 2024". Unite.ai. Retrieved 26 May 2024.
^ "Introducing OpenAI o1-preview". OpenAI. 12 September 2024.
^ Knight, Will. "OpenAI Announces a New AI Model, Code-Named Strawberry, That Solves Difficult Problems Step by Step". Wired. ISSN 1059-1028. Retrieved 17 September 2024.
^ "OpenAI Employee Claims AGI Has Been Achieved". Orbital Today. 13 December 2024. Retrieved 27 December 2024.
^ "AI Index: State of AI in 13 Charts". hai.stanford.edu. 15 April 2024. Retrieved 7 June 2024.
^ "Next-Gen AI: OpenAI and Meta's Leap Towards Reasoning Machines". Unite.ai. 19 April 2024. Retrieved 7 June 2024.
^ James, Alex P. (2022 ). "The Why, What, and How of Artificial General Intelligence Chip Development". IEEE Transactions on Cognitive and Developmental Systems. 14 (2 ): 333-347. arXiv:2012.06338. doi:10.1109/ TCDS.2021.3069871. ISSN 2379-8920. S2CID 228376556. Archived from the original on 28 August 2022. Retrieved 28 August 2022.
^ Pei, Jing; Deng, Lei; Song, Sen; Zhao, Mingguo; Zhang, Youhui; Wu, Shuang; Wang, Guanrui; Zou, Zhe; Wu, Zhenzhi; He, Wei; Chen, Feng; Deng, Ning; Wu, Si; Wa
