Ashish Vaswani

Summary: Co-lead author of "Attention Is All You Need." Designed/implemented first Transformer models with Illia Polosukhin; crucially involved in every aspect. Co-founded Essential AI (enterprise LLMs).

Details

  • Affiliation: Essential AI (Co-founder, CEO), formerly Google Brain
  • Key Contributions:
    • Transformer architecture — Co-designed with Illia Polosukhin; implemented first models
    • Tensor2Tensor library — Open-source framework that accelerated Transformer research
    • Essential AI — Enterprise-focused LLM platform (founded 2023)
  • Website: [Essential AI]
  • Notable Works:
    • "Attention Is All You Need" (NeurIPS 2017) — Lead implementation
    • Tensor2Tensor (Google Brain open source)

Significance

Transformer implementation lead. While Shazeer proposed attention formulation, Vaswani/Polosukhin built the actual architecture and training pipeline that made it work.

Essential AI applies Transformers to enterprise automation — relevant if you consider industry track.

Related Concepts

Sources

  • arxiv-1706.03762: Author contributions note: "Ashish, with Illia, designed and implemented the first Transformer models and has been crucially involved in every aspect of this work."