Get Started
GitHub
API

Table of Contents

2.5.0

Introduction

Introduction to the Fine-Tuning Scheduler

Enhanced Distributed Strategies

Model Parallel Scheduled Fine-Tuning
FSDP Scheduled Fine-Tuning

Configurable Profiling

Profiling Example

Advanced Usage

LR Scheduler Reinitialization
Optimizer Reinitialization

Basic Examples

Notebook-based Fine-Tuning Scheduler tutorial
CLI-based Fine-Tuning Scheduler tutorial

APIs

Fine-Tuning Scheduler
MemProfiler

Community

Contributor Covenant Code of Conduct
Contributing
Fine-Tuning Scheduler Governance
Changelog

Docs >
Overview: module code

Shortcuts

All modules for which code is available

finetuning_scheduler.fts
finetuning_scheduler.fts_supporters
finetuning_scheduler.strategy_adapters.base
finetuning_scheduler.strategy_adapters.fsdp
finetuning_scheduler.strategy_adapters.model_parallel
fts_examples.profiling.config
fts_examples.profiling.memprofiler

© Copyright Copyright (c) 2021-2024, Dan Dale.

Built with Sphinx using a theme provided by Read the Docs.

To analyze traffic and optimize your experience, we serve cookies on this site. By clicking or navigating, you agree to allow our usage of cookies. Read Read the Docs' Privacy Policy.

Get Started
Blog
Ecosystem

PyTorch Lightning
TorchMetrics
Lightning Flash
Lightning Transformers
Lightning Bolts

Github
Grid.ai