# Demodiff Code

* **Pretraining:** See the `pretrain` folder. The main entry point is `main.py`.
* **Checkpoints:** After pretraining, place the checkpoint in `downstream/pretrained` along with the configuration file (examples are provided).
* **Inference:** Run `inference.py` in the `downstream` folder to perform downstream evaluation.
* **Tokenizer:** An example tokenizer is provided in the `data` folder.
* **Data Example:** A downstream task is provided in `downstream/context_data/Albuterol_Similarity`.