Cuenca, Ecuador

Generative AI

Fine-tuning Open Source LLMsin Cuenca

Explore Fine-Tuning Open Source LLMs training to learn model customisation, supervised fine-tuning, parameter-efficient techniques, and dataset preparation. Gain practical experience with Python, Hugging Face Transformers, PyTorch, and…

40 Hours/5 daysLive virtual trainingIntermediate

Training is delivered live online for learners in Cuenca, Ecuador. Corporate programs are available for teams; request a quotation to confirm the schedule.

Plan your attendance

Training information for Cuenca

Selected country and city time: Europe/London. Times follow the selected country and city. Choose another time zone below if needed.

Training information for Cuenca
DeliveryLive online · Classroom when confirmed
Price$819 USD

Bookings and payments are in USD only.

ScheduleCourse-page batches starting in the next 7 days; subject to availability
Exam voucherCheck with StepMerit
Classroom venueClient premises or a StepMerit-arranged conference hall in Cuenca, subject to venue and batch confirmation.
Weekend · 5 training days

Starts Nov 21, 2026, 9:00 AM

First session ends Nov 21, 2026, 3:00 PM

Europe/London · Weekend hours are flexible. Schedule and delivery subject to confirmation.

Enquire about this batch
Weekday · 5 training days

Starts Nov 23, 2026, 9:00 AM

First session ends Nov 23, 2026, 5:00 PM

Europe/London · Schedule and delivery subject to confirmation.

Enquire about this batch
Corporate batches

Chat with us on WhatsApp to arrange training for your team.

What you will learnExpand syllabus +
  • Module 1: Introduction to Open Source Large Language Models
    • Understanding large language models and their capabilities
    • Overview of open source and openly available LLMs
    • Popular models and ecosystems, including Llama, Mistral, and Hugging Face
    • Use cases and limitations of open source LLMs
  • Module 2: Transformer Architecture and LLM Fundamentals
    • Transformer architecture and attention mechanisms
    • Tokenisation, embeddings, and positional information
    • Pretraining, inference, and text generation
    • Understanding model parameters and context windows
  • Module 3: Development Environment Setup
    • Setting up Python, Jupyter Notebook, and required libraries
    • Working with PyTorch and Hugging Face Transformers
    • Configuring GPU, cloud notebook, or local computing environments
    • Managing dependencies and model files
  • Module 4: Working with Pretrained Open Source Models
    • Accessing pretrained models from Hugging Face Hub
    • Loading tokenisers and model checkpoints
    • Selecting models based on task requirements and hardware capacity
    • Running inference and evaluating baseline outputs
  • Module 5: Dataset Preparation and Preprocessing
    • Collecting and validating task-specific training data
    • Cleaning, deduplication, and text normalisation
    • Formatting instruction-response datasets
    • Splitting datasets into training, validation, and test sets
    • Identifying privacy risks and sensitive information in datasets
  • Module 6: Fundamentals of LLM Fine-Tuning
    • Understanding transfer learning and supervised fine-tuning
    • Comparing prompting, retrieval-augmented generation (RAG), and fine-tuning
    • Defining training objectives and evaluation criteria
    • Understanding loss functions, epochs, batch sizes, and learning rates
  • Module 7: Supervised Fine-Tuning (SFT)
    • Preparing instruction-tuning datasets
    • Configuring training arguments and model checkpoints
    • Training a pretrained model using supervised examples
    • Tracking training loss and validation performance
    • Saving and loading fine-tuned model checkpoints
  • Module 8: Parameter-Efficient Fine-Tuning (PEFT)
    • Introduction to parameter-efficient adaptation techniques
    • Understanding Low-Rank Adaptation (LoRA)
    • Exploring Quantised LoRA (QLoRA)
    • Configuring adapters and trainable parameters
    • Comparing full fine-tuning with parameter-efficient approaches
  • Module 9: Fine-Tuning with Hugging Face Tools
    • Using Transformers and the Trainer API
    • Working with the Datasets and PEFT libraries
    • Configuring tokenisers, collators, and training pipelines
    • Managing checkpoints, logs, and model artefacts
  • Module 10: GPU Memory and Training Optimisation
    • Understanding GPU memory consumption during training
    • Using quantisation and gradient accumulation
    • Exploring mixed-precision training and gradient checkpointing
    • Adjusting batch sizes and sequence lengths
    • Identifying common training bottlenecks
  • Module 11: Model Evaluation and Quality Assessment
    • Establishing baseline and post-training performance
    • Evaluating generated responses for relevance and accuracy
    • Using task-specific metrics and human evaluation
    • Testing for hallucinations, bias, and inconsistent outputs
    • Performing regression tests across representative prompts
  • Module 12: Experiment Tracking and Troubleshooting
    • Monitoring training metrics and experiment configurations
    • Identifying overfitting and underfitting
    • Troubleshooting dataset, tokenisation, and memory errors
    • Comparing model checkpoints and training runs
    • Documenting experiments for reproducibility
  • Module 13: Fine-Tuned Model Inference and Deployment
    • Loading fine-tuned models and adapter weights
    • Configuring generation parameters and inference settings
    • Serving models through Python applications or APIs
    • Understanding model quantisation for inference
    • Reviewing deployment, latency, and resource requirements
  • Module 14: Responsible AI, Security, and Model Governance
    • Reviewing training data quality, consent, and licensing considerations
    • Assessing bias, privacy, and potential misuse risks
    • Protecting model artefacts and sensitive datasets
    • Documenting model limitations and intended use
    • Establishing human review and ongoing evaluation practices
  • Module 15: Capstone Project and Practical Assessment
    • Selecting an open source LLM for a defined use case
    • Preparing a domain-specific dataset and baseline model
    • Implementing supervised fine-tuning or LoRA/QLoRA
    • Evaluating and comparing model performance before and after fine-tuning
    • Demonstrating the adapted model and documenting results
    • Presenting project findings, limitations, and future improvements
  • Training Delivery and Learning Support
    • Instructor-led learning with practical demonstrations and guided exercises
    • Hands-on labs using suitable open source models and tools
    • Project-based learning focused on real-world LLM customisation
    • StepMerit training support for learners in Cuenca, Ecuador

StepMerit will make the necessary arrangements to provide the required lab environment. Lab costs, where applicable, will be charged separately.

Exam details

  • Exam Level: Intermediate – Fine-Tuning Open Source LLMs
  • Exam Type: Online computer-based examination consisting of multiple-choice questions and practical, scenario-based questions.
  • Number of Questions: 40 questions.
  • Exam Duration: 90 minutes.
  • Passing Score: 70% (28 out of 40 questions).
  • Exam Delivery: Online assessment through the StepMerit learning and assessment platform.
  • Practical Assessment: Learners may be assessed on dataset preparation, fine-tuning configuration, model evaluation, and interpretation of training results.
  • Certification: Learners who meet the assessment requirements may receive a StepMerit Certificate of Course Completion. This is a StepMerit course certificate, not an official certification issued by a model provider.
  • Exam Preparation: Review course modules, practise fine-tuning workflows, complete hands-on exercises, and understand model evaluation techniques.
  • Training and Assessment Support: StepMerit provides course-related learning support for participants in Cuenca, Ecuador.

Plan your learning

Who this course is for

AI Engineers Machine Learning Engineers Generative AI Developers Data Scientists Python Developers NLP Engineers and Practitioners Deep Learning Professionals LLM Application Developers AI Researchers and Research Scholars Software Developers Exploring Open Source LLMs IT Professionals Upskilling in Generative AI Technical Professionals seeking Fine-Tuning Open Source LLMs training in Cuenca, Ecuador

Before you begin

Python Programming: Basic knowledge of Python, including functions, classes, libraries, and data handling. Machine Learning Fundamentals: Understanding of model training, validation, evaluation, and basic machine learning concepts. Deep Learning Knowledge: Familiarity with neural networks, gradient descent, loss functions, and backpropagation is recommended. Large Language Model Fundamentals: Basic understanding of LLMs, transformer architecture, tokens, embeddings, and text generation. Transformer Models: Familiarity with attention mechanisms, pretrained models, and tokenization is beneficial. Python AI Libraries: Basic experience with PyTorch and familiarity with the Hugging Face…

Learning outcomes

Problem Statement: Healthcare organisations manage large volumes of patient education materials, hospital guidelines, frequently asked questions, clinical information documents, and administrative resources. General-purpose large language models may not consistently follow healthcare-specific terminology, response formats, or approved communication guidelines. Healthcare teams need AI systems that can provide clear, accessible, and consistent general health information while protecting sensitive data and avoiding unsupported medical claims. The organisation wanted to explore fine-tuning open source LLMs to support healthcare education and information services. How We Overcame the Problem…

Related reading

Course blogs for learners in Cuenca

Explore this course locally

Know the location

Local information: Cuenca

Cuenca, Ecuador. View city location ↗

City overview

Cuenca, Ecuador.

Geography & administration

Time zone: Europe/London.

Education & learning

Course learning optionsExplore Fine-tuning Open Source LLMs through live online instructor-led training. Cuenca learners can request a corporate program for their teams. Course duration: 40 Hours/5 days. Check the upcoming online batches and contact StepMerit to confirm the schedule and exam arrangements.