Three articles from outside EA
AI Bias in one graph • X post
The graph speaks for itself: asked to pick a number between 1 and 10, AI picks 7 more often, while humans do this, too, but to a far lesser degree (lucky number?). While I am not sure how this graph was generated, or how truthful it is, it exemplifies a fundamental attitude we need to take towards AI.
🌲 What this means: The point of this tweet is that humans say "seven" slightly more often, which is then picked up and amplified by AI, making it far more often. Gradient descent here refers to the way models are trained: "Reducing its error function by taking the step with the highest reduction, i.e. the gradient", in this case, learning to reply "7". This shows that biases can be amplified when AI models are trained with large societal implications. This reminds me of an intriguing essay arguing that Western values and biases (on which AI is built) might be out of place in other cultures.
Computer Science Conferences impose submission caps due to AI "Tsunami"
"Ten years ago, the International Conference on Learning Representations (ICLR), [...], received about 500 submitted papers. When the deadline for the 2027 meeting passed last month, the number had ballooned to more than 40,000". As a result, conferences are putting caps on the number of submissions. The likely reason is the advent of generative AI (the article shows an impressive graph).
🌲 My take: There is a gold-rush feeling at the moment motivated by (1) the publication quantity and citations as academic currency, (2) the easy access to generative AI, making it easy to create and (3) the lack of quality assessment automation (for good reasons!). Collectively, we see a similar development on social media: A rise in new content, as people try to figure out how the new paradigm works. I don't like to use the term "slop", as some of this content/papers aren't bad, and some AI-generated content is genuinely a new "medium". However, I think this points to a need for some form of automated content assessment to encourage quality over quantity.
How to assemble science
In this essay, Helen Pearson argues that science's real bottleneck is often not a shortage of knowledge, but a failure to synthesise what already exists. Systematic reviews and meta-analyses reveal patterns invisible in any single study. For example, Sudden Infant Death (SIDS) risk from prone sleeping was synthesizable by 1970 but went unacted-on for two more decades, an estimated 50,000 preventable infant deaths later. Climate Science is another such example.
🌲 My take: I think this is precisely where academic tools and AI can be so brilliant, as they can amplify the sometimes dull task of assembling 100s of studies necessary for meta-reviews. However, traditional AI tools are often unsuitable here, as they are not reproducible and most scientists lack the skills to build custom tools. Tools like Nested Knowledge are attempting to fix this, but are not well known in the community (and are expensive). There is an innovation gap here.