Imagine a future where artificial intelligence quietly shoulders the drudgery of software development: refactoring tangled code, migrating legacy systems, and hunting down race conditions, so that human engineers can devote themselves to architecture, design, and the genuinely novel problems still beyond a machine’s reach. Recent advances appear to have nudged that future tantalizingly close, but a new paper by researchers at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) and several collaborating institutions argues that this potential future reality demands a hard look at present-day challenges.  Titled “Challenges and Paths Towards AI for Software Engineering,” the work maps the many software-engineering tasks beyond code generation, identifies current bottlenecks, and highlights research directions to overcome them, aiming to let humans focus on high-level design while routine work is automated.  “Everyone is talking about how we don’t need programmers anymore, and there’s all this automation now available,” says Armando Solar‑Lezama, MIT professor of electrical engineering and computer science, CSAIL principal investigator, and senior author of the study. “On the one hand, the field has made tremendous progress. We have tools that are way more powerful than any we’ve seen before. But there’s also a long way to go toward really getting the full promise of automation that we would expect.” Solar-Lezama argues that popular narratives often shrink software engineering to “the undergrad programming part: someone hands you a spec for a little function and you implement it, or solving LeetCode-style programming interviews.” Real practice is far broader. It includes everyday refactors that polish design, plus sweeping migrations that move millions of lines from COBOL to Java and reshape entire businesses. It requires nonstop testing and analysis — fuzzing, property-based testing, and other methods — to catch concurrency bugs, or patch zero-day flaws. And it involves the maintenance grind: documenting decade-old code, summarizing change histories for new teammates, and reviewing pull requests for style, performance, and security. Industry-scale code optimization — think re-tuning GPU kernels or the relentless, multi-layered refinements behind Chrome’s V8 engine — remains stubbornly hard to evaluate. Today’s headline metrics were designed for short, self-contained problems, and while multiple-choice tests still dominate natural-language research, they were never the norm in AI-for-code. The field’s de facto yardstick, SWE-Bench, simply asks a model to patch a GitHub issue: useful, but still akin to the “undergrad programming exercise” paradigm. It touches only a few hundred lines of code, risks data leakage from public repositories, and ignores other real-world contexts — AI-assisted refactors, human–AI pair programming, or performance-critical rewrites that span millions of lines. Until benchmarks expand to capture those higher-stakes scenarios, measuring progress — and thus accelerating it — will remain an open challenge. If measurement is one obstacle, human‑machine communication is another. First author Alex  Gu, an MIT graduate student in electrical engineering and computer science, sees today’s interaction as “a thin line of communication.” When he asks a system to generate code, he often receives a large, unstructured file and even a set of unit tests, yet those tests tend to be superficial. This gap extends to the AI’s ability to effectively use the wider suite of software engineering tools, from debuggers to static analyzers, that humans rely on for precise control and deeper understanding. “I don’t really have much control over what the model writes,” he says. “Without a channel for the AI to expose its own confidence — ‘this part’s correct … this part, maybe double‑check’ — developers risk blindly trusting hallucinated logic that compiles, but collapses in production. Another critical aspect is having the AI know when to defer to the user for clarification.”  Scale compounds these difficulties. Current AI models struggle profoundly with large code bases, often spanning millions of lines. Foundation models learn from public GitHub, but “every company’s code base is kind of different and unique,” Gu says, making proprietary coding conventions and specification requirements fundamentally out of distribution. The result is code that looks plausible yet calls non‑existent functions, violates internal style rules, or fails continuous‑integration pipelines. This often leads to AI-generated code that “hallucinates,” meaning it creates content that looks plausible but doesn’t align with the specific internal conventions, helper functions, or architectural patterns of a given company.  Models will also often retrieve incorrectly, because it retrieves code with a similar name (syntax) rather than functionality and logic, which is what a model might need to know how to write the function. “Standard retrieval techniques are very easily fooled by pieces of code that are doing the same thing but look different,” says Solar‑Lezama.  The authors mention that since there is no silver bullet to these issues, they’re calling instead for community‑scale efforts: richer, having data that captures the process of developers writing code (for example, which code developers keep versus throw away, how code gets refactored over time, etc.), shared evaluation suites that measure progress on refactor quality, bug‑fix longevity, and migration correctness; and transparent tooling that lets models expose uncertainty and invite human steering rather than passive acceptance. Gu frames the agenda as a “call to action” for larger open‑source collaborations that no single lab could muster alone. Solar‑Lezama imagines incremental advances—“research results taking bites out of each one of these challenges separately”—that feed back into commercial tools and gradually move AI from autocomplete sidekick toward genuine engineering partner. “Why does any of this matter? Software already underpins finance, transportation, health care, and the minutiae of daily life, and the human effort required to build and maintain it safely is becoming a bottleneck. An AI that can shoulder the grunt work — and do so without introducing hidden failures — would free developers to focus on creativity, strategy, and ethics” says Gu. “But that future depends on acknowledging that code completion is the easy part; the hard part is everything else. Our goal isn’t to replace programmers. It’s to amplify them. When AI can tackle the tedious and the terrifying, human engineers can finally spend their time on what only humans can do.” “With so many new works emerging in AI

Ahead of Intelligent Health (13-14 September 2023, Basel, Switzerland), we asked Yurii Kryvoborodov, Head of AI & Data Consulting, Unicsoft, his thoughts on the future of AI in healthcare.   Do you think the increased usage of Generative AI and LLMs will have a dramatic impact on the healthcare industry and, if so, how?   Generative AI is just a part of the disruptive impact of all AI tech on the healthcare industry. It allows to dramatically reduce time efforts, costs and chances of mistakes. Generative AI and LLMs are applied to automating clinical documentation, drug discovery, tailoring of treatment plans to individual patients, real-time clinical decision support and health monitoring, extracting valuable insights from unstructured clinical records, streamlining administrative tasks like billing and claims processing, providing instant access to comprehensive medical knowledge. And this list continues.

We sat with Benjamin von Deschwanden, Co-Founder and CPO at Acodis AG, to ask him his thoughts on the future of AI in healthcare.   Do you think the increased usage of Generative AI and LLMs will have a dramatic impact on the healthcare industry and, if so, how?   I think that the strength of Generative AI lies in making huge amounts of information accessible without needing to manually sift through the source material. Being able to quickly answer any questions is going to be transformative for everyone working with increasingly bigger data sets.The challenge will be to ensure that the information we get by means of Generative AI is correct and complete – especially in healthcare – as the consequences of wrong data can be fatal. We at Acodis are actively working on practical applications of Generative AI inside our Intelligent Document Processing (IDP) Platform for Life Science and Pharma clients to drive efficiency and accelerate time to market, whilst controlling the risks.

Intelligent Health 2024 returns to Basel, Switzerland on 11th–12th September. We’ve got prominent speakers. An extensive programme. Groundbreaking advancements in #HealthTech. And much, much more. Our incredible 2024 programme will dive deeper than ever before. From sharing the latest innovation insights to exploring use cases of AI application in clinical settings from around the world. All through our industry-renowned talks, limitless networking opportunities, and much-loved, hands-on workshops. Read on to discover what themes await at the world’s largest AI and healthcare summit. 

We sat down with Margrietha H. (Greet) Vink, Erasmus MC’s Director of Research Development Office and Smart Health Tech Center, to ask her for her thoughts on the future of AI in healthcare.   Do you think the increased usage of Generative AI and LLMs will have a dramatic impact on the healthcare industry and, if so, how?   The integration of Generative AI and LLMs into the healthcare industry holds the potential to revolutionise various aspects of patient care, from diagnostics and treatment to administrative tasks and drug development. However, this transformation will require careful consideration of ethical, legal, and practical challenges to ensure that the benefits are realised in a responsible and equitable manner.