Panoptic

Panoptic

Frank Hutter

Sources
English
Frank Hutter is a German computer scientist recognized for his contributions to machine learning, particularly in the areas of automated machine learning (AutoML), hyperparameter optimization, meta-learning, and tabular machine learning.[5] He is known for his role in establishing AutoML as a key area in artificial intelligence research. He is currently a Hector-Endowed Fellow and PI at the ELLIS Institute Tübingen and a Full Professor (W3) for Machine Learning at the Department of Computer Science, University of Freiburg. His academic background and associations also include the University of British Columbia, as well as Holger Hoos, Kevin Leyton-Brown, and Kevin Murphy.

Education and academic career

Frank Hutter received his academic training in computer science at Darmstadt University of Technology, where he completed his Vordiplom (comparable to a BSc) and Hauptdiplom (equivalent to MSc) by 2004. He later pursued his PhD at the University of British Columbia under the supervision of Profs. Holger Hoos, Kevin Leyton-Brown, and Kevin Murphy, where his doctoral thesis, titled "Automated Configuration of Algorithms for Solving Hard Computational Problems," was awarded the CAIAC Doctoral Dissertation Award for the best thesis in Artificial Intelligence completed at a Canadian university in 2009.[2,1]
Hutter did his postdoctoral research at the University of British Columbia, where he worked from 2009 to 2013. In 2013, he moved to the University of Freiburg, initially leading an Emmy Noether Research Group, and in 2017, he was appointed as a Full Professor. His contributions to machine learning have been recognized globally, particularly his work in AutoML and hyperparameter optimization. Overall, Hutter has authored over 180 peer-reviewed publications, which have garnered more than 89,000 citations, reflecting the high impact of his work.[3,4]

Contributions in AutoML

Hutter's early research laid the groundwork for the field of Automated Machine Learning (AutoML), and he has been a key figure in establishing AutoML as a distinct research area. Along with various colleagues, he organized the AutoML workshops from 2014 to 2021, wrote the first book on AutoML, and taught the first MOOC on AutoML. He also co-founded the AutoML conference in 2022 and served as its general chair for the first two years. He also published prominent works in various subfields of AutoML, such as hyperparameter optimization, neural architecture search, meta-learning, and AutoML systems.[8,9,10,6] He is currently the most highly cited researcher in AutoML.[11]

Contributions in machine learning for tabular data

Hutter has made many contributions to machine learning for tabular data. He led the development of the first widely adopted AutoML system for tabular data, AutoWEKA, which was published at KDD 2013 and received the test of time award at KDD (2023). Subsequently, he led the development of Auto-sklearn, the first highly used AutoML system for tabular data in Python, and with it, won the first international AutoML challenge and the subsequent second international AutoML challenge, both of which only included tabular data.[12,13] More recently, he focused on tabular foundation models, including TabPFN, which was published in Nature magazine. In 2024, he also co-founded Prior Labs, the first company focusing on tabular foundation models.

Awards and honors

Hutter has received numerous awards throughout his career. In 2023, he won the KDD Test of Time Award for Research together with Chris Thornton, Holger H. Hoos, and Kevin Leyton-Brown.[14] He has received three grants from the ERC, including the ERC Starting Grant (2016) and ERC Consolidator Grant (2022), as well as an ERC Proof of Concept Grant (2020).[17,15,16] In 2021, he became an ELLIS Unit Director and was also recognized as a EurAI Fellow, in addition to receiving the AIJ Prominent Paper Award.[19,18] Earlier, he was a recipient of the Google Faculty Research Award in 2018.[20] His groundbreaking research was acknowledged early in his career with the IJCAI Distinguished Paper Award in 2013 and the IJCAI/JAIR Best Paper Prize in 2010.[22,21]

Representative publications

Representative publications include the 2019 book Automated machine learning: methods, systems, challenges, edited by F. Hutter, L. Kotthoff, and J. Vanschoren (Springer Nature, www.automl.org/book). Conference publications include "Efficient and Robust Automated Machine Learning" by M. Feurer, A. Klein, K. Eggensperger, T. Springenberg, M. Blum, and F. Hutter (NeurIPS 2015), as well as "Decoupled weight decay regularization" by I. Loshchilov and F. Hutter (ICLR 2018). Later works presented at ICLR include "Understanding and Robustifying Differentiable Architecture Search" by A. Zela, T. Elsken, T. Saikia, Y. Marrakschi, T. Brox, and F. Hutter (2020), and "TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second" by N. Hollmann, S. Müller, K. Eggensperger, and F. Hutter (2023).
Name
Frank Hutter
Workplaces
University of Freiburg, ELLIS Institute Tübingen
Alma mater
University of British Columbia
Doctoral advisor
Holger Hoos, Kevin Leyton-Brown and Kevin Murphy
Sources
English

References

  1. [1]
    ^ Kevin Murphy[English]
  2. [2]
  3. [3]
    ^ Machine Learning Lab by Frank Hutter[English]
  4. [4]
    ^ Frank Hutter[English]
  5. [5]
  6. [6]
  7. [7]
  8. [8]
  9. [9]
  10. [10]
    ^ Profiles[English]
  11. [11]
  12. [12]
  13. [13]
  14. [14]
    ^ Awards[English]
  15. [15]
    ^ Starting Grant (2025-01-31)[English]
  16. [16]
    ^ Consolidator Grant (2025-01-31)[English]
  17. [17]
    ^ Proof of Concept (2025-01-23)[English]
  18. [18]
    ^ Awards[English]
  19. [19]
  20. [20]
  21. [21]
  22. [22]
  23. [23]
    ^ Automated Machine LearningThe Springer Series on Challenges in Machine Learning (2019)[English]
  24. [24]
    ^ Efficient and Robust Automated Machine LearningAdvances in Neural Information Processing Systems by Matthias Feurer; Aaron Klein; Katharina Eggensperger; Jost Springenberg; Manuel Blum; Frank Hutter (2015)[English]
  25. [25]
    ^ Decoupled Weight Decay Regularization by Ilya Loshchilov; Frank Hutter (2017)[English]
  26. [26]
    ^ Understanding and Robustifying Differentiable Architecture Search by Arber Zela; Thomas Elsken; Tonmoy Saikia; Yassine Marrakchi; Thomas Brox; Frank Hutter (2019)[English]
  27. [27]
    ^ TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second by Noah Hollmann; Samuel Müller; Katharina Eggensperger; Frank Hutter (2022)[English]

Article Statistics

Word Count Comparison

Comparing content volume across 1 language sources

PanopticPanopticAggregated
726 words
Unique (1 source)Full consensus (1 sources)
Englishen
703 words
1
Language Sources
726
Aggregated Words
726
Full Consensus
726
Unique Claims
0
Disagreements