Stanford
Institute for Computational & Mathematical Engineering

Transformers & Large Language Models Workshop

We'll explore the fascinating world of Transformers and Large Language Models (LLMs) within the field of Natural Language Processing (NLP). We'll delve into the background, core concepts and evolution of these advanced models, offering you a balanced mix of theory and real-world applications that will enable learners to apply Transformers and LLMs effectively in the context of NLP.

  • Brief history and evolution of Natural Language Processing (NLP) methods and why they were developed.
  • Deep dive into the Transformer architecture, including useful advice and techniques.
  • Explanation of how Large Language Models (LLMs) relate to Transformers, with a focus on how LLMs are built.
  • Prompting and fine tuning methods for LLMs, tailored to enhance their application in specific scenarios.
  • Concrete applications of how LLMs are used.

COURSE PREREQUISITES

  1. College-level Calculus and Linear Algebra.
  2. A basic understanding of Machine Learning concepts.
  3. Prior NLP and deep learning knowledge is beneficial.

 

Workshop Event Details

   Date: Friday, March 21, 2025
   Time: 9 AM to 5 PM 
   Learning Format: In-Person
   Location: Stanford University Main Campus
   Credential: Certificate of Completion
   Tuition: $850.00 (Affiliates)
                  $850.00 (ICME Nonprofit Collaborators)
                  $1350.00 (Non-Affiliates)

Secure Your Spot Today!

Limited enrollment to 20 people. A 10% discount will be applied to groups of 5 or more from the same company. For any questions, please contact Tanya Schornack, Program Manager of Affiliates & Career Services at ICME.

WORKSHOP INSTRUCTORS
 

Afshine Amidi
Senior Machine Learning Scientist at Netflix

 

 

Shervine Amidi, ICME Alum
Senior Software Engineer at Google
 

WORKSHOP OUTLINE

Part 1.  Evolution of NLP Leading to Transformer Models

  • Overview of the NLP field and its evolution.
  • Technical walkthrough of each component of the Transformer and their purpose.
  • Advantages of Transformer models.
  • Practical insights for working with Transformers.
     

Part 2. Transformers and Derived Models

  • Overview of key Transformer-based models.
  • Optimizations of the attention mechanism.
  • Derived architectures.
     

Part 3. Deep Dive into Large Language Models (LLMs)

  • Understanding the foundational relationship between Transformers and Large Language Models.
  • Techniques and methodologies for effective prompting of LLMs.
  • Approaches to fine-tuning LLMs for tailored performance.
  • Overview of the diverse applications and impact of LLMs in various fields.

FREQUENTLY ASKED QUESTIONS

  1. Why is registration limited? To enhance individual engagement and hands-on learning, our workshop is held in person with a limited number of participants giving priority to ICME affiliate members.
  2. How do I know if my company is an ICME affiliate? Click the link to learn if your company is an ICME affiliate: https://icme.stanford.edu/Affiliate-Program
  3. How do I pay for the workshop? After registering, you will receive an email asking for your payment.
  4. Do you offer group discounts? We offer a 10% group discount if an organization registers at least five people. For more information, please contact Tanya Schornack at tschorna@stanford.edu.
  5. When will I receive my certificate? Expect to receive it within one week after the workshop concludes.
  6. What is the refund policy? Refunds are processed on a case-by-case basis. For credit card payments, a 2.9% fee will be deducted from the total amount. To request a refund, please contact ICME at icme-contact@stanford.edu. ICME reserves the right to decline refund requests.
  7. Do I need to bring my own computer to the workshop? Yes, you will need to bring your own computer with a full charge, as outlets are limited. We'll send additional notifications closer to the event regarding accessing class materials and a website.
  8. Will lunch be provided during the workshop? Lunch will be provided for all participants during the workshop. If you have any dietary requirements, please let us know.
  9. Where will the workshop be held? The workshop is scheduled to take place on the Stanford main campus. Detailed information will be sent to you after registration.
  10. Where should I park? Visitor parking is available in designated Stanford campus areas. All visitor parking payments are contactless and managed through ParkMobile. Detailed information on the nearest parking lots will be sent to you after registration. Click here to purchase visitor parking.

COURSE CANCELLATIONS

ICME reserves the right to cancel a course for any reason. If ICME cancels a course, you will automatically be granted a full refund, including the registration fee and any course fees.