{"cells":[{"cell_type":"markdown","metadata":{"id":"bGZ4dcZQ2CoD"},"source":["# Transformer Model Guide for USA AI Olympiad\n","\n","This notebook now includes both:\n","\n","1. **NLP transformer models**\n","2. **Vision transformer models**\n","3. **CLIP models**\n","\n","It is designed as a practical quick-start guide for students.\n","\n","The covered models are:\n","\n","## NLP transformer models\n","- `bert-base-uncased`\n","- `roberta-base`\n","- `distilbert-base-uncased`\n","- `albert-base-v2`\n","- `microsoft/deberta-base`\n","- `gpt2`\n","- `microsoft/Phi-3-mini-4k-instruct`\n","- `t5-small`\n","- `t5-base`\n","- `google/mt5-base`\n","- `facebook/bart-base`\n","\n","## Vision transformer models\n","- `google/vit-base-patch16-224`\n","- `facebook/deit-base-patch16-224`\n","- `microsoft/beit-base-patch16-224`\n","- `microsoft/swin-tiny-patch4-window7-224`\n","\n","## CLIP models\n","- `openai/clip-vit-base-patch16`\n","- `openai/clip-vit-base-patch32`\n","- `openai/clip-vit-large-patch14`\n","- `openai/clip-vit-large-patch14-336`\n","\n","For each model family, this notebook explains:\n","\n","1. What it is used for  \n","2. How it works  \n","3. Its high-level architecture  \n","4. Similarities and differences compared with familiar models  \n","5. How to load it in code  \n","6. Toy examples  \n","7. How to create pretrained and randomly initialized versions\n"],"id":"bGZ4dcZQ2CoD"},{"cell_type":"markdown","metadata":{"id":"hbSSUzdm2CoF"},"source":["## 1. Installation\n","\n","- `transformers`: Hugging Face model and tokenizer/image-processor classes"],"id":"hbSSUzdm2CoF"},{"cell_type":"code","execution_count":1,"metadata":{"id":"0IwosUBW2CoF","colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"status":"ok","timestamp":1774138989066,"user_tz":240,"elapsed":17205,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"207152df-8a9e-417c-e702-f1a24be36a49"},"outputs":[{"output_type":"stream","name":"stdout","text":["Requirement already satisfied: transformers in /usr/local/lib/python3.12/dist-packages (5.0.0)\n","Requirement already satisfied: filelock in /usr/local/lib/python3.12/dist-packages (from transformers) (3.25.2)\n","Requirement already satisfied: huggingface-hub<2.0,>=1.3.0 in /usr/local/lib/python3.12/dist-packages (from transformers) (1.7.1)\n","Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.12/dist-packages (from transformers) (2.0.2)\n","Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.12/dist-packages (from transformers) (26.0)\n","Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.12/dist-packages (from transformers) (6.0.3)\n","Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.12/dist-packages (from transformers) (2025.11.3)\n","Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /usr/local/lib/python3.12/dist-packages (from transformers) (0.22.2)\n","Requirement already satisfied: typer-slim in /usr/local/lib/python3.12/dist-packages (from transformers) (0.24.0)\n","Requirement already satisfied: safetensors>=0.4.3 in /usr/local/lib/python3.12/dist-packages (from transformers) (0.7.0)\n","Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.12/dist-packages (from transformers) (4.67.3)\n","Requirement already satisfied: fsspec>=2023.5.0 in /usr/local/lib/python3.12/dist-packages (from huggingface-hub<2.0,>=1.3.0->transformers) (2025.3.0)\n","Requirement already satisfied: hf-xet<2.0.0,>=1.4.2 in /usr/local/lib/python3.12/dist-packages (from huggingface-hub<2.0,>=1.3.0->transformers) (1.4.2)\n","Requirement already satisfied: httpx<1,>=0.23.0 in /usr/local/lib/python3.12/dist-packages (from huggingface-hub<2.0,>=1.3.0->transformers) (0.28.1)\n","Requirement already satisfied: typer in /usr/local/lib/python3.12/dist-packages (from huggingface-hub<2.0,>=1.3.0->transformers) (0.24.1)\n","Requirement already satisfied: typing-extensions>=4.1.0 in /usr/local/lib/python3.12/dist-packages (from huggingface-hub<2.0,>=1.3.0->transformers) (4.15.0)\n","Requirement already satisfied: anyio in /usr/local/lib/python3.12/dist-packages (from httpx<1,>=0.23.0->huggingface-hub<2.0,>=1.3.0->transformers) (4.12.1)\n","Requirement already satisfied: certifi in /usr/local/lib/python3.12/dist-packages (from httpx<1,>=0.23.0->huggingface-hub<2.0,>=1.3.0->transformers) (2026.2.25)\n","Requirement already satisfied: httpcore==1.* in /usr/local/lib/python3.12/dist-packages (from httpx<1,>=0.23.0->huggingface-hub<2.0,>=1.3.0->transformers) (1.0.9)\n","Requirement already satisfied: idna in /usr/local/lib/python3.12/dist-packages (from httpx<1,>=0.23.0->huggingface-hub<2.0,>=1.3.0->transformers) (3.11)\n","Requirement already satisfied: h11>=0.16 in /usr/local/lib/python3.12/dist-packages (from httpcore==1.*->httpx<1,>=0.23.0->huggingface-hub<2.0,>=1.3.0->transformers) (0.16.0)\n","Requirement already satisfied: click>=8.2.1 in /usr/local/lib/python3.12/dist-packages (from typer->huggingface-hub<2.0,>=1.3.0->transformers) (8.3.1)\n","Requirement already satisfied: shellingham>=1.3.0 in /usr/local/lib/python3.12/dist-packages (from typer->huggingface-hub<2.0,>=1.3.0->transformers) (1.5.4)\n","Requirement already satisfied: rich>=12.3.0 in /usr/local/lib/python3.12/dist-packages (from typer->huggingface-hub<2.0,>=1.3.0->transformers) (13.9.4)\n","Requirement already satisfied: annotated-doc>=0.0.2 in /usr/local/lib/python3.12/dist-packages (from typer->huggingface-hub<2.0,>=1.3.0->transformers) (0.0.4)\n","Requirement already satisfied: markdown-it-py>=2.2.0 in /usr/local/lib/python3.12/dist-packages (from rich>=12.3.0->typer->huggingface-hub<2.0,>=1.3.0->transformers) (4.0.0)\n","Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /usr/local/lib/python3.12/dist-packages (from rich>=12.3.0->typer->huggingface-hub<2.0,>=1.3.0->transformers) (2.19.2)\n","Requirement already satisfied: mdurl~=0.1 in /usr/local/lib/python3.12/dist-packages (from markdown-it-py>=2.2.0->rich>=12.3.0->typer->huggingface-hub<2.0,>=1.3.0->transformers) (0.1.2)\n"]}],"source":["!pip install transformers"],"id":"0IwosUBW2CoF"},{"cell_type":"markdown","metadata":{"id":"OH7sHkxA2CoF"},"source":["## 2. Big picture\n","\n","There are three main transformer architecture types among the NLP models:\n","\n","| Architecture | Best for | Models |\n","|---|---|---|\n","| **Encoder-only** | Understanding text: classification, token labeling, extractive QA, embeddings | `bert-base-uncased`, `roberta-base`, `distilbert-base-uncased`, `albert-base-v2`, `microsoft/deberta-base` |\n","| **Decoder-only** | Text generation, continuation, chat, instruction following | `gpt2`, `microsoft/Phi-3-mini-4k-instruct` |\n","| **Encoder-decoder** | Text-to-text tasks such as translation, summarization, rewriting | `t5-small`, `t5-base`, `google/mt5-base`, `facebook/bart-base` |\n","\n","For the vision side:\n","\n","| Family | Best for | Models |\n","|---|---|---|\n","| **Vision Transformers** | Image classification and visual representation learning | `google/vit-base-patch16-224`, `facebook/deit-base-patch16-224`, `microsoft/beit-base-patch16-224`, `microsoft/swin-tiny-patch4-window7-224` |\n","| **CLIP models** | Image-text matching, zero-shot classification, multimodal retrieval | `openai/clip-vit-base-patch16`, `openai/clip-vit-base-patch32`, `openai/clip-vit-large-patch14`, `openai/clip-vit-large-patch14-336` |\n"],"id":"OH7sHkxA2CoF"},{"cell_type":"markdown","metadata":{"id":"8LXLW37X2CoG"},"source":["## 3. NLP transformer models"],"id":"8LXLW37X2CoG"},{"cell_type":"markdown","metadata":{"id":"i5z2GQxu2CoG"},"source":["### `bert-base-uncased`\n","\n","**Main use cases**\n","- Text classification\n","- Sentiment analysis\n","- Named entity recognition\n","- Extractive QA\n","- Feature extraction\n","\n","**How it works**\n","- BERT is an **encoder-only** transformer.\n","- It is pretrained with **masked language modeling**.\n","- It uses both left and right context.\n","\n","**Architecture**\n","- **Encoder-only**\n","- English\n","- **Uncased**\n","\n","**Comparison**\n","- This is the classic BERT-style model.\n","- Better for understanding tasks than free-form generation.\n","- Unlike T5, it usually needs a task-specific head.\n"],"id":"i5z2GQxu2CoG"},{"cell_type":"markdown","metadata":{"id":"EXRdAIbw2CoG"},"source":["### `roberta-base`\n","\n","**Main use cases**\n","- Same broad tasks as BERT\n","- Often a strong BERT alternative for English understanding tasks\n","\n","**How it works**\n","- RoBERTa is also an **encoder-only masked language model**.\n","- It improves on BERT mostly through better pretraining choices.\n","\n","**Architecture**\n","- **Encoder-only**\n","\n","**Comparison**\n","- A good mental model is: **RoBERTa = better-trained BERT**.\n"],"id":"EXRdAIbw2CoG"},{"cell_type":"markdown","metadata":{"id":"sab1vPt62CoG"},"source":["### `distilbert-base-uncased`\n","\n","**Main use cases**\n","- Same types of tasks as BERT\n","- Smaller and faster inference\n","\n","**How it works**\n","- DistilBERT is a distilled version of BERT.\n","- It keeps much of the performance while reducing size.\n","\n","**Architecture**\n","- **Encoder-only**\n","\n","**Comparison**\n","- Similar to BERT, but lighter and faster.\n"],"id":"sab1vPt62CoG"},{"cell_type":"markdown","metadata":{"id":"rQ1AMWUj2CoG"},"source":["### `albert-base-v2`\n","\n","**Main use cases**\n","- Standard NLP understanding tasks\n","- Good when parameter efficiency matters\n","\n","**How it works**\n","- ALBERT is a BERT-family encoder model.\n","- It reduces parameter count through factorization and parameter sharing.\n","\n","**Architecture**\n","- **Encoder-only**\n","\n","**Comparison**\n","- Similar use to BERT, but more parameter-efficient.\n"],"id":"rQ1AMWUj2CoG"},{"cell_type":"markdown","metadata":{"id":"fEz5vbfq2CoH"},"source":["### `microsoft/deberta-base`\n","\n","**Main use cases**\n","- Text classification\n","- NER\n","- QA\n","- General language understanding\n","\n","**How it works**\n","- DeBERTa is an encoder-only model.\n","- Its main innovation is **disentangled attention**.\n","\n","**Architecture**\n","- **Encoder-only**\n","\n","**Comparison**\n","- Think of it as a more advanced BERT-family encoder.\n"],"id":"fEz5vbfq2CoH"},{"cell_type":"markdown","metadata":{"id":"_NxNXWNI2CoH"},"source":["### `gpt2`\n","\n","**Main use cases**\n","- Text continuation\n","- Open-ended generation\n","- Prompting demos\n","\n","**How it works**\n","- GPT-2 is a **causal language model**.\n","- It predicts the next token using previous tokens only.\n","\n","**Architecture**\n","- **Decoder-only**\n","\n","**Comparison**\n","- Unlike BERT, it is designed for generation.\n"],"id":"_NxNXWNI2CoH"},{"cell_type":"markdown","metadata":{"id":"7VVsWpVr2CoH"},"source":["### `microsoft/Phi-3-mini-4k-instruct`\n","\n","**Main use cases**\n","- Chat-style prompting\n","- Instruction following\n","- Lightweight reasoning-oriented generation\n","\n","**How it works**\n","- Phi-3-mini-4k-instruct is an instruction-tuned causal language model.\n","\n","**Architecture**\n","- **Decoder-only**\n","\n","**Comparison**\n","- Closer to a small chat LLM than to BERT.\n","- More instruction-oriented than raw GPT-2.\n"],"id":"7VVsWpVr2CoH"},{"cell_type":"markdown","metadata":{"id":"ltfrSeeT2CoH"},"source":["### `t5-small`\n","\n","**Main use cases**\n","- Summarization\n","- Translation\n","- Question answering as generation\n","- Rewriting\n","\n","**How it works**\n","- T5 treats all NLP tasks as **text-to-text**.\n","\n","**Architecture**\n","- **Encoder-decoder**\n","\n","**Comparison**\n","- Unlike BERT, it generates text outputs.\n","- Unlike GPT-style models, it has both an encoder and decoder.\n"],"id":"ltfrSeeT2CoH"},{"cell_type":"markdown","metadata":{"id":"OOJFSiHI2CoH"},"source":["### `t5-base`\n","\n","**Main use cases**\n","- Same as `t5-small`, but larger and usually stronger\n","\n","**How it works**\n","- Same T5 text-to-text framework.\n","\n","**Architecture**\n","- **Encoder-decoder**\n"],"id":"OOJFSiHI2CoH"},{"cell_type":"markdown","metadata":{"id":"kbQSQwOI2CoH"},"source":["### `google/mt5-base`\n","\n","**Main use cases**\n","- Multilingual translation\n","- Multilingual summarization\n","- Multilingual text-to-text tasks\n","\n","**How it works**\n","- mT5 is the multilingual version of T5.\n","\n","**Architecture**\n","- **Encoder-decoder**\n","\n","**Comparison**\n","- Similar workflow to T5, but multilingual.\n"],"id":"kbQSQwOI2CoH"},{"cell_type":"markdown","metadata":{"id":"MlN_SzSv2CoH"},"source":["### `facebook/bart-base`\n","\n","**Main use cases**\n","- Summarization\n","- Rewriting\n","- Seq2seq generation\n","\n","**How it works**\n","- BART is pretrained as a denoising autoencoder.\n","- Its encoder is bidirectional like BERT.\n","- Its decoder is autoregressive like GPT-style models.\n","\n","**Architecture**\n","- **Encoder-decoder**\n","\n","**Comparison**\n","- Easy memory trick:\n","  - **BERT-like encoder**\n","  - **GPT-like decoder**\n"],"id":"MlN_SzSv2CoH"},{"cell_type":"markdown","metadata":{"id":"kG6iy_n02CoH"},"source":["## 4. NLP loading and toy examples"],"id":"kG6iy_n02CoH"},{"cell_type":"code","execution_count":2,"metadata":{"id":"6x3q42t12CoH","executionInfo":{"status":"ok","timestamp":1774139071239,"user_tz":240,"elapsed":82170,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}}},"outputs":[],"source":["import torch\n","from transformers import (\n","    AutoTokenizer,\n","    AutoModel,\n","    AutoModelForCausalLM,\n","    AutoModelForSeq2SeqLM,\n","    AutoConfig,\n",")"],"id":"6x3q42t12CoH"},{"cell_type":"code","source":["# Encoder example\n","name = \"bert-base-uncased\"\n","tokenizer = AutoTokenizer.from_pretrained(name)\n","model = AutoModel.from_pretrained(name)\n","\n","text = \"Transformers are very useful for language understanding.\"\n","inputs = tokenizer(text, return_tensors=\"pt\")\n","\n","print(inputs)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)\n","\n","with torch.no_grad():\n","    outputs = model(**inputs)\n","\n","print(\"Encoder last hidden state shape:\", outputs.last_hidden_state.shape)"],"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["c6358dd4c5d44f7480b353cba749fc22","a3ecd2f5e94d499e9d6d0837ce4e8af9","1bd557247aad48769825263d5c77d5fc","febb37f9de7148dbb356e434c40c6553","b5e32d0087494416b9c05b16c98d5a90","848e6a16f61a477ca394e361695263eb","7181faa8adca4651b4a4d30d0fd30ccd","443b56998c354e08a88e8087fe79681c","55a6dcabb24e411ca8753cd974b5f5c2","47076c924d2642f49b1b315123910b1b","c2253a479f4d46349797ae5c76ce5caa","60f983780c124b3d967a321478a1cde4","c2a39ac4b0924d95b593c89ef48004d1","bbc5608d12804d08819f1967ac6f1571","1f116e23fd014ba0a2f990dd0bb31279","3990dd60b1174b9e943f2774fb0427d1","394c49de5e4a4b31807ac476639ffde9","668c5ad9863d468bbe5017bc9ba98e50","4d3063ccca6f4aa59842ead9b375aff0","95d307ed819e4baab083e5bfd9297444","02279f996d924fee9e56e13272e5de00","e5c824d331314f0aa2dc13bbe6c1605a","eba38c0a650b487595b85916099c1ca3","2b7b39d017d8446b83f33d0f89a8a0ff","4bd57bcad8eb4179ada26b6c221b2ced","dd0ec690139d4a2f82a10735a9f69ced","d1029d32c0aa4261995a6a435deb0da7","29699abcf1ff477ea99ef26c45bc07f2","2a68599aa7c74c9aa956cdb64ea470ad","f1162b0de8b44ba1a892712427f9ed55","5772fa9bec3a467bb45290d3f11ed113","4b296844bace484997abb8d73f8042df","2531f23e11254362a3cec6fdb26b1eda","28e9ff173c92415ca5d9e2f5a572578e","9d3b2640ba364f68bb81de55eb9d4662","9973d4827ffe4fb09cb0667967443bac","bb0361c9cfa045d5866dcde97e588a1e","88951c2dd4794674bead5a26314ae405","94a2bbcbb2724022be0ff43aca12f342","71fc032c0b3147509731800777fab28c","16ea55f9d9ff4174b330be7cd2cda64b","a7387c32397b45b988df9e88910ca211","2407da2a2cfb4922ae2b35921a8fc65f","63312cd62b134d3f8f57057832b9e520","0df2f7d906364335874dc6f52f578c26","a4367092824f46149c02962fa5ac3f5d","7d2897e9c35845e4acc6bf21581e587f","36725359a21b43ab942c8a3d681fc0aa","841497034735431eb59a948c6be284b7","8cd8d518f9fd4e3da6e4b0b7d7ae5ca7","f868a45df8914b9aad9d503fa430917d","0d9f01d776cd4fb78e836b34fbdcf98f","2e7b37d958e148d4ac221e85a27f2b2e","a2f2813a05cd46d8b8b147048ed64d3c","3fcb7bb960ee4ad29342d53a00a3f34f","ba91336474d64e63adb7aed2adeb5cdf","0a9d5debe31a48c787f56b4e9d55befd","0168147350a04c95b17a8341a9d0c0fa","bccfe0b2bb38492b8c8d81ed60d9b76f","49203e33a77640488a0c1142e25f1ce4","f2cfeeb729344272a8f1480f2a4d3297","84520d9c16774b75955bbd5cd9209b74","a8a32cc6f5dc44ffaee3e366ff6c88a1","2596fd6f2d344c4ab0858b4a4e77f8e3","d7f4b6e85af940c7b6c71691d824475d","7017076445054509bf976f76e61cf4e8"]},"id":"5o6_Sy662cry","executionInfo":{"status":"ok","timestamp":1774139098153,"user_tz":240,"elapsed":26904,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"7ad255c6-d06d-4583-b6fc-32a235118249"},"id":"5o6_Sy662cry","execution_count":3,"outputs":[{"output_type":"stream","name":"stderr","text":["/usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_auth.py:94: UserWarning: \n","The secret `HF_TOKEN` does not exist in your Colab secrets.\n","To authenticate with the Hugging Face Hub, create a token in your settings tab (https://huggingface.co/settings/tokens), set it as secret in your Google Colab and restart your session.\n","You will be able to reuse this secret in all of your notebooks.\n","Please note that authentication is recommended but still optional to access public models or datasets.\n","  warnings.warn(\n"]},{"output_type":"display_data","data":{"text/plain":["config.json:   0%|          | 0.00/570 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"c6358dd4c5d44f7480b353cba749fc22"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.\n","WARNING:huggingface_hub.utils._http:Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.\n"]},{"output_type":"display_data","data":{"text/plain":["tokenizer_config.json:   0%|          | 0.00/48.0 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"60f983780c124b3d967a321478a1cde4"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["vocab.txt: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"eba38c0a650b487595b85916099c1ca3"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["tokenizer.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"28e9ff173c92415ca5d9e2f5a572578e"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["model.safetensors:   0%|          | 0.00/440M [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"0df2f7d906364335874dc6f52f578c26"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["Loading weights:   0%|          | 0/199 [00:00<?, ?it/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"ba91336474d64e63adb7aed2adeb5cdf"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["BertModel LOAD REPORT from: bert-base-uncased\n","Key                                        | Status     |  | \n","-------------------------------------------+------------+--+-\n","cls.predictions.transform.dense.bias       | UNEXPECTED |  | \n","cls.seq_relationship.bias                  | UNEXPECTED |  | \n","cls.seq_relationship.weight                | UNEXPECTED |  | \n","cls.predictions.bias                       | UNEXPECTED |  | \n","cls.predictions.transform.dense.weight     | UNEXPECTED |  | \n","cls.predictions.transform.LayerNorm.weight | UNEXPECTED |  | \n","cls.predictions.transform.LayerNorm.bias   | UNEXPECTED |  | \n","\n","Notes:\n","- UNEXPECTED\t:can be ignored when loading from different task/architecture; not ok if you expect identical arch.\n"]},{"output_type":"stream","name":"stdout","text":["{'input_ids': tensor([[  101, 19081,  2024,  2200,  6179,  2005,  2653,  4824,  1012,   102]]), 'token_type_ids': tensor([[0, 0, 0, 0, 0, 0, 0, 0, 0, 0]]), 'attention_mask': tensor([[1, 1, 1, 1, 1, 1, 1, 1, 1, 1]])}\n","0\n","embeddings\n","BertEmbeddings(\n","  (word_embeddings): Embedding(30522, 768, padding_idx=0)\n","  (position_embeddings): Embedding(512, 768)\n","  (token_type_embeddings): Embedding(2, 768)\n","  (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","  (dropout): Dropout(p=0.1, inplace=False)\n",")\n","1\n","encoder\n","BertEncoder(\n","  (layer): ModuleList(\n","    (0-11): 12 x BertLayer(\n","      (attention): BertAttention(\n","        (self): BertSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=True)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","        (output): BertSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","      )\n","      (intermediate): BertIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BertOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","        (dropout): Dropout(p=0.1, inplace=False)\n","      )\n","    )\n","  )\n",")\n","2\n","pooler\n","BertPooler(\n","  (dense): Linear(in_features=768, out_features=768, bias=True)\n","  (activation): Tanh()\n",")\n","Encoder last hidden state shape: torch.Size([1, 10, 768])\n"]}]},{"cell_type":"code","execution_count":4,"metadata":{"id":"8OQM_DOI2CoH","colab":{"base_uri":"https://localhost:8080/","height":970,"referenced_widgets":["6299934079d942eaa20811dfa3c61c89","cd37634a1ef2471aa30bd30cd07e3996","b7dd6275a75c48f387e3c939d78127b8","5d59289c56fb498e9f72fb33d9acea63","59ef85b391354e32bebab426e2dd1c4d","af4507319ae9429f9a8c4058ae42eb47","676d931cc24542a2a682ef18a3685924","9df148a161b348e5aa28ceaef47c0244","8a649f9160074ad5b250372fef7820a9","d983749d347140b6bb6394a9fbd6c1fa","ebd4eecdf2b34696938859b01f86f454","356b2012708b4ae4bbbc76fe52f8b1d9","528ad86891ef4b40ad8c43c669aaa691","2df56fa64b8e47e897a6c3f41f773fe4","c3d5376c141a4faf99662bb63df68bd7","9e0c79611b794db983e4e9481b3bf583","34936e88f7804224b30cc61a391a4809","aee02a3c7269490ea8918f2b509834ef","4ef0170fa8934f1ba7265e4bd7983969","111219f675f5432da8ccf799f8d6b934","2ea9e8fb360846d5b2911f778a7bace4","c7263d783a3e4f90a177dd30b6a280d1","9d753817b6ce4a85b09ac75d63453cff","f4df1af1793544c5956d7eb5989b8481","6b7325dcfec544e893901c98e22416e8","176748cd3e78495cab22d9a43cc83a64","4992f2e06fad4715b53361aef54332dc","4e3310c01bf347008990fdc2c7745aa0","e2184b13e3024c51977a58fb024582a9","e356c19cc3804920a40771289f8b35ee","97c9e9932f7e4f09af726ba3a6763377","8d3b03e29a894b7393364af5a450c8aa","7d4c589931e1457d9528b63bea33ca77","8aeb9add6b2c4db49094f7f41758ff10","411e657edc0e454a831ba5a2e78c7903","fc8ed2cbcf24438a99b79984c9050926","df538915985b4dbcbc8f1384feea0d2f","3a1e9402af0b43e48b2134c7d3bb783f","e0185d76e5094ecaa98fbc99ccf7f872","01899a62f50447b08e3fdf4729e0286d","9e2ea2c6d04e41668e39c6aafb765df1","9f92571c47034bbaae8dcbc706ee215d","1c88e857e493494cb7a725001aa6f253","acf8d3b301a54a188e67d3c34beeb1d2","dd5e6bfd9bad4d4084f9495dffa79459","9b3e41d5dfc2450694165875086f4a32","061aecaa63e74abdbd274c4e81aa99ec","e4ff9f1f2e094b93935d8bb9f11cdba2","d9f79688a31f450aab224fa3fab0ec29","1cf20e594364472a8e22f21745e7e957","e6625114507243ebbfadd2376da5d6eb","6158cdace7b5415a925b29f017f94618","011ddd9cf4ef4029aa0048da67c638d8","5c2a84c9b21743eb9a072b41772f8d76","2ded1b82cef14066ab008d61e3de304a","2d43b3d2bbf9443186f6cbb220943f1b","f95e59464ed941f69382ad22041dee00","d8aa647c2c314cceaf3251ae5e265f98","4a1e4f8015e74d9e97ed3b710c5d748f","4f1077c605e546db8b3abf735c6691bc","cd50f2e1149e4fc683ede7bfa5b2a05a","3d38ae0f8ebd4079a6fd692f6a22fe1b","b119d31901b946a1b7a4d9e45d93592b","70ebdcc0bd154b9592fe925ac80fb05b","6087a132a11644b2800970a784602c27","e2d0f9b6f3ea4bf2961836e7962c644d","e71d4e0b3a954c32abbee2d5750c9e21","b6ef08532dd74fc38e50366887340346","fe346f25df6444018cf083b8f5431e33","0bcb77bacb814dd495eca8f7b7ed9cf9","2e610f31ff3549fcb76a91314db72032","7aecc01c736f46caa9b52f399622cf32","143bc5d02f1542b2978ce1507c0a6ad3","b76e2e9a7294454baffa344128b6ed94","5998b4fcf910454c8ea1b90678611ed0","99d87dbcb8ad42be972c5201cca79643","f4885475b76644bea20a86c9887b2377","7b7c16edea314fd58b85b78c5c5efae8","b18b1888ab574c67adf2551ed49652b9","310d0cdc30ba4869b7183d42bc7e3762","44e6354b8a4f4c8d8c66f3c6d491a91b","a12de6f1c1264296950d7155dea20703","b770d3dd96bb4cfcbfb303e0af718b1a","fb07092f359a4954845e97e51097e212","21a6936336ac4d0ca9000638cd4d530f","55faccd14f1543b1985ac823c7a8a0af","39ed2622f26c4405a2d7957559a23020","daca91326dfa4b06b62f2c2cf913e4a3"]},"executionInfo":{"status":"ok","timestamp":1774139112700,"user_tz":240,"elapsed":14533,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"0c83d2fc-f973-4dc5-9b7b-3bed009a6d0e"},"outputs":[{"output_type":"display_data","data":{"text/plain":["config.json:   0%|          | 0.00/665 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"6299934079d942eaa20811dfa3c61c89"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["tokenizer_config.json:   0%|          | 0.00/26.0 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"356b2012708b4ae4bbbc76fe52f8b1d9"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["vocab.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"9d753817b6ce4a85b09ac75d63453cff"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["merges.txt: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"8aeb9add6b2c4db49094f7f41758ff10"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["tokenizer.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"dd5e6bfd9bad4d4084f9495dffa79459"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["model.safetensors:   0%|          | 0.00/548M [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"2d43b3d2bbf9443186f6cbb220943f1b"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["Loading weights:   0%|          | 0/148 [00:00<?, ?it/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"e71d4e0b3a954c32abbee2d5750c9e21"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["GPT2LMHeadModel LOAD REPORT from: gpt2\n","Key                  | Status     |  | \n","---------------------+------------+--+-\n","h.{0...11}.attn.bias | UNEXPECTED |  | \n","\n","Notes:\n","- UNEXPECTED\t:can be ignored when loading from different task/architecture; not ok if you expect identical arch.\n"]},{"output_type":"display_data","data":{"text/plain":["generation_config.json:   0%|          | 0.00/124 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"7b7c16edea314fd58b85b78c5c5efae8"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["Setting `pad_token_id` to `eos_token_id`:50256 for open-end generation.\n"]},{"output_type":"stream","name":"stdout","text":["{'input_ids': tensor([[7454, 2402,  257,  640,   11,  257, 3710, 4499, 6121,  364,  290]]), 'attention_mask': tensor([[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]])}\n","0\n","transformer\n","GPT2Model(\n","  (wte): Embedding(50257, 768)\n","  (wpe): Embedding(1024, 768)\n","  (drop): Dropout(p=0.1, inplace=False)\n","  (h): ModuleList(\n","    (0-11): 12 x GPT2Block(\n","      (ln_1): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","      (attn): GPT2Attention(\n","        (c_attn): Conv1D(nf=2304, nx=768)\n","        (c_proj): Conv1D(nf=768, nx=768)\n","        (attn_dropout): Dropout(p=0.1, inplace=False)\n","        (resid_dropout): Dropout(p=0.1, inplace=False)\n","      )\n","      (ln_2): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","      (mlp): GPT2MLP(\n","        (c_fc): Conv1D(nf=3072, nx=768)\n","        (c_proj): Conv1D(nf=768, nx=3072)\n","        (act): NewGELUActivation()\n","        (dropout): Dropout(p=0.1, inplace=False)\n","      )\n","    )\n","  )\n","  (ln_f): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n",")\n","1\n","lm_head\n","Linear(in_features=768, out_features=50257, bias=False)\n","Once upon a time, a student learned transformers and was inspired to create a new character for her world. But then, once she began working on the script, she was forced to cut out everything because\n"]}],"source":["# Decoder example\n","name = \"gpt2\"\n","tokenizer = AutoTokenizer.from_pretrained(name)\n","model = AutoModelForCausalLM.from_pretrained(name)\n","\n","prompt = \"Once upon a time, a student learned transformers and\"\n","inputs = tokenizer(prompt, return_tensors=\"pt\")\n","\n","print(inputs)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)\n","\n","with torch.no_grad():\n","    output_ids = model.generate(\n","        **inputs,\n","        max_new_tokens=30,\n","        do_sample=True,\n","        temperature=0.8\n","    )\n","\n","print(tokenizer.decode(output_ids[0], skip_special_tokens=True))\n"],"id":"8OQM_DOI2CoH"},{"cell_type":"code","execution_count":5,"metadata":{"id":"qHi73dfm2CoH","colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["c41f8f9a039d4f1ab890aa0ab7e180c6","059e4cf965e8440a8a19e776e7ed57fe","a601fc0e1b2d4ec2a2ddd8a187457c78","5e9048178cbc45279a05505ebc767c9a","82595082bea342fd870f7d4f0549ace9","f6682790f226496899816e59fe26d3c0","1402225553a04836abab4871797af3c7","501c63d88580482982c5b2a19abce971","c32cd60437f74115a63850ecc72d6074","12c5437fa06949b699ded88190a05538","4e557f93b791443392f6612121d92ee4","6937760b7d7c45c5bc2d60f51bc4a4c1","0b9e33ba7bc24b9c8d00c76fd2fc84c8","db4a0671308f431180cf45dacfc49795","a79186a3f1f042bf843f8dcf91784356","be29a063c8414d16b0bb52d487623367","e5e6de05f66445f585d049338782e9ef","adfa293df63141f1aa890f3f930bcd72","e207946947f049178234e439c1cec032","b630d81cfc6e44878240db7dcde76949","109463faac47442ba1d5e99055b37ffa","44164cbff799474eb56ac543f41b6dbb","a28e57c5d3ae429bb937b7e4beb669c3","40d4ecdd7bb84b87894ffe1266e6e9f8","51c1a3e866eb45e197d3c592131ddef6","f0167c1dfb6e4e1b84bbe5d11319684e","7c5cf5b8fbea405c8ff9d5d500520c9a","44816ad96fd94f01bf4304808579a75d","bb8d1ecb200f4610acb196b567708d71","7f81c42c2473493e899768e542bc3d43","154836ab1f614e969750976f81c1f26b","c3130fb3b9454a4b836fb91c41ca44fa","8b5ca33d93e1410f9c096c0bf8b3531e","4ec2c47f375d42319ed9fe1519a9c26b","93ab1cee13f44d1dbb4659b20204c1d3","ba75fb8c03cc4e3bbfe81929c185edb6","ec56746ecd2a49fcbae75168c323bfdc","1cd08453cf2541da8823c9c2c096a7fe","fcd7118005314dc48665edc8e0f6b55c","fa7772f3e0914968974b4f6f47300ffc","9264e7267f90487592086e278869ab73","092f8d02d1804e7b8e04ebec63201710","d44699ce75c24b71ac5e56afb396226e","071b85921ab64142b1aea082321d1b4d","eefc4bd8560c405d9f1783cb3e48a8d9","f32f193fe7a849dd8e36ed65f5210296","10d4eca65cdd4fd9badaa9cd2dd1f2ce","4aa1ed9db65c458f877488d369c31f2e","cff899ba63574e26870066732055c55a","f8e1dc3faa684bc199056e56940b3bd1","de4886b66efc48c18f2b9c53ad26eac0","318ef76bc37d4d0d8c209edf37864989","4db249a6578e42d19e5b239154aecbbb","139dd9aeedb04df9b2c027f6fc6b9759","045f283538584f64bd6c4db5fd317e7d","2c5cd1ead70e4741831906ca0c7b4ae0","4f56221897614ab99a609c12f4d6b70a","2de8ab3b214146028ffc504b2883e108","e426037efd8841cabda80ea26221912e","d526793fc3614005af27f5552620affb","9147ad1488a2420bb39f5ad51a2ed724","3986a20ae1504abeb430af7e3d8c869b","db5a771e145240c686cb9c657cd56df2","aa48f47b2e814b0a87a57c78ee566367","cc5f9cd2496d46b58c36cf252c958941","42422513cd79488d871d857dc28851f7","e2a8037ccc9c45318362c5fa4f2e7aed","2146cfb1a2ab4950ba3d981782eb3f73","25325f2c98e34b6aa5ca23e3c56d1c85","a61b55ce8d0d411abde2398f2e0c2363","555fcf6288be4a2fb262861c2028a896","9c2474006b774e3ea258283fed7fc916","34687e615cec4fe699ba4cc8482fd79e","6fa1c39c265741e2b4e57cdc3eadeba8","f6bbf1202de54d81b37ee4b48d709664","a1544fa5935a4d54aa0b207493467a82","0774bd4debb24f6c9ee0391a68dd7e9f"]},"executionInfo":{"status":"ok","timestamp":1774139121032,"user_tz":240,"elapsed":8330,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"812951e8-3767-4093-c347-ee0d2e940dc4"},"outputs":[{"output_type":"display_data","data":{"text/plain":["config.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"c41f8f9a039d4f1ab890aa0ab7e180c6"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["tokenizer_config.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"6937760b7d7c45c5bc2d60f51bc4a4c1"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["spiece.model:   0%|          | 0.00/792k [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"a28e57c5d3ae429bb937b7e4beb669c3"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["tokenizer.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"4ec2c47f375d42319ed9fe1519a9c26b"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["model.safetensors:   0%|          | 0.00/242M [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"eefc4bd8560c405d9f1783cb3e48a8d9"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["Loading weights:   0%|          | 0/131 [00:00<?, ?it/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"2c5cd1ead70e4741831906ca0c7b4ae0"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["generation_config.json:   0%|          | 0.00/147 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"e2a8037ccc9c45318362c5fa4f2e7aed"}},"metadata":{}},{"output_type":"stream","name":"stdout","text":["{'input_ids': tensor([[21603,    10, 31220,     7,    33,  2021, 24228,  2250,   261,    16,\n","          1612,     6,  2267,     6,  2931,     6,    11,  1249, 20226,  1036,\n","             5,     1]]), 'attention_mask': tensor([[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]])}\n","0\n","shared\n","Embedding(32128, 512)\n","1\n","encoder\n","T5Stack(\n","  (embed_tokens): Embedding(32128, 512)\n","  (block): ModuleList(\n","    (0): T5Block(\n","      (layer): ModuleList(\n","        (0): T5LayerSelfAttention(\n","          (SelfAttention): T5Attention(\n","            (q): Linear(in_features=512, out_features=512, bias=False)\n","            (k): Linear(in_features=512, out_features=512, bias=False)\n","            (v): Linear(in_features=512, out_features=512, bias=False)\n","            (o): Linear(in_features=512, out_features=512, bias=False)\n","            (relative_attention_bias): Embedding(32, 8)\n","          )\n","          (layer_norm): T5LayerNorm()\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","        (1): T5LayerFF(\n","          (DenseReluDense): T5DenseActDense(\n","            (wi): Linear(in_features=512, out_features=2048, bias=False)\n","            (wo): Linear(in_features=2048, out_features=512, bias=False)\n","            (dropout): Dropout(p=0.1, inplace=False)\n","            (act): ReLU()\n","          )\n","          (layer_norm): T5LayerNorm()\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","      )\n","    )\n","    (1-5): 5 x T5Block(\n","      (layer): ModuleList(\n","        (0): T5LayerSelfAttention(\n","          (SelfAttention): T5Attention(\n","            (q): Linear(in_features=512, out_features=512, bias=False)\n","            (k): Linear(in_features=512, out_features=512, bias=False)\n","            (v): Linear(in_features=512, out_features=512, bias=False)\n","            (o): Linear(in_features=512, out_features=512, bias=False)\n","          )\n","          (layer_norm): T5LayerNorm()\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","        (1): T5LayerFF(\n","          (DenseReluDense): T5DenseActDense(\n","            (wi): Linear(in_features=512, out_features=2048, bias=False)\n","            (wo): Linear(in_features=2048, out_features=512, bias=False)\n","            (dropout): Dropout(p=0.1, inplace=False)\n","            (act): ReLU()\n","          )\n","          (layer_norm): T5LayerNorm()\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","      )\n","    )\n","  )\n","  (final_layer_norm): T5LayerNorm()\n","  (dropout): Dropout(p=0.1, inplace=False)\n",")\n","2\n","decoder\n","T5Stack(\n","  (embed_tokens): Embedding(32128, 512)\n","  (block): ModuleList(\n","    (0): T5Block(\n","      (layer): ModuleList(\n","        (0): T5LayerSelfAttention(\n","          (SelfAttention): T5Attention(\n","            (q): Linear(in_features=512, out_features=512, bias=False)\n","            (k): Linear(in_features=512, out_features=512, bias=False)\n","            (v): Linear(in_features=512, out_features=512, bias=False)\n","            (o): Linear(in_features=512, out_features=512, bias=False)\n","            (relative_attention_bias): Embedding(32, 8)\n","          )\n","          (layer_norm): T5LayerNorm()\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","        (1): T5LayerCrossAttention(\n","          (EncDecAttention): T5Attention(\n","            (q): Linear(in_features=512, out_features=512, bias=False)\n","            (k): Linear(in_features=512, out_features=512, bias=False)\n","            (v): Linear(in_features=512, out_features=512, bias=False)\n","            (o): Linear(in_features=512, out_features=512, bias=False)\n","          )\n","          (layer_norm): T5LayerNorm()\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","        (2): T5LayerFF(\n","          (DenseReluDense): T5DenseActDense(\n","            (wi): Linear(in_features=512, out_features=2048, bias=False)\n","            (wo): Linear(in_features=2048, out_features=512, bias=False)\n","            (dropout): Dropout(p=0.1, inplace=False)\n","            (act): ReLU()\n","          )\n","          (layer_norm): T5LayerNorm()\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","      )\n","    )\n","    (1-5): 5 x T5Block(\n","      (layer): ModuleList(\n","        (0): T5LayerSelfAttention(\n","          (SelfAttention): T5Attention(\n","            (q): Linear(in_features=512, out_features=512, bias=False)\n","            (k): Linear(in_features=512, out_features=512, bias=False)\n","            (v): Linear(in_features=512, out_features=512, bias=False)\n","            (o): Linear(in_features=512, out_features=512, bias=False)\n","          )\n","          (layer_norm): T5LayerNorm()\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","        (1): T5LayerCrossAttention(\n","          (EncDecAttention): T5Attention(\n","            (q): Linear(in_features=512, out_features=512, bias=False)\n","            (k): Linear(in_features=512, out_features=512, bias=False)\n","            (v): Linear(in_features=512, out_features=512, bias=False)\n","            (o): Linear(in_features=512, out_features=512, bias=False)\n","          )\n","          (layer_norm): T5LayerNorm()\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","        (2): T5LayerFF(\n","          (DenseReluDense): T5DenseActDense(\n","            (wi): Linear(in_features=512, out_features=2048, bias=False)\n","            (wo): Linear(in_features=2048, out_features=512, bias=False)\n","            (dropout): Dropout(p=0.1, inplace=False)\n","            (act): ReLU()\n","          )\n","          (layer_norm): T5LayerNorm()\n","          (dropout): Dropout(p=0.1, inplace=False)\n","        )\n","      )\n","    )\n","  )\n","  (final_layer_norm): T5LayerNorm()\n","  (dropout): Dropout(p=0.1, inplace=False)\n",")\n","3\n","lm_head\n","Linear(in_features=512, out_features=32128, bias=False)\n","Transformers are powerful neural models used in language, vision, audio, and multimodal learning.\n"]}],"source":["# Encoder-decoder example\n","name = \"t5-small\"\n","tokenizer = AutoTokenizer.from_pretrained(name)\n","model = AutoModelForSeq2SeqLM.from_pretrained(name)\n","\n","prompt = \"summarize: Transformers are powerful neural models used in language, vision, audio, and multimodal learning.\"\n","inputs = tokenizer(prompt, return_tensors=\"pt\")\n","\n","print(inputs)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)\n","\n","with torch.no_grad():\n","    output_ids = model.generate(**inputs, max_new_tokens=20)\n","\n","print(tokenizer.decode(output_ids[0], skip_special_tokens=True))\n"],"id":"qHi73dfm2CoH"},{"cell_type":"code","execution_count":6,"metadata":{"id":"kw0Bfkuk2CoI","colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["ed33abe395db458d8df7a61483b24448","1687a396e37846309173787ad32cf5c4","6e8fe3115d814503be3d75e06c91ce97","32a2c4b2535d41669bb4b1db1e8619ae","3aa4588e9e9844d9ba89848c7328e711","6c70c26493fe4e758719b75f2f816660","f36b13cac7e54ea888cbe6e5fa141e1d","96e8e132d1914fafab238e25cf142e15","2d045a136a58469f90ccbb8a27204261","7e51b92113cd4b1dbff5df2c866176a8","d8fa10097bd544229314f400d551a322"]},"executionInfo":{"status":"ok","timestamp":1774139128656,"user_tz":240,"elapsed":7617,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"5ec0484a-8913-4ba9-febf-a1ae4eaaf06d"},"outputs":[{"output_type":"display_data","data":{"text/plain":["config.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"ed33abe395db458d8df7a61483b24448"}},"metadata":{}},{"output_type":"stream","name":"stdout","text":["{'input_ids': tensor([[21603,    10, 31220,     7,    33,  2021, 24228,  2250,   261,    16,\n","          1612,     6,  2267,     6,  2931,     6,    11,  1249, 20226,  1036,\n","             5,     1]]), 'attention_mask': tensor([[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]])}\n","0\n","model\n","BartModel(\n","  (shared): BartScaledWordEmbedding(50265, 768, padding_idx=1)\n","  (encoder): BartEncoder(\n","    (embed_tokens): BartScaledWordEmbedding(50265, 768, padding_idx=1)\n","    (embed_positions): BartLearnedPositionalEmbedding(1026, 768)\n","    (layers): ModuleList(\n","      (0-5): 6 x BartEncoderLayer(\n","        (self_attn): BartAttention(\n","          (k_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (v_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (q_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (out_proj): Linear(in_features=768, out_features=768, bias=True)\n","        )\n","        (self_attn_layer_norm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","        (activation_fn): GELUActivation()\n","        (fc1): Linear(in_features=768, out_features=3072, bias=True)\n","        (fc2): Linear(in_features=3072, out_features=768, bias=True)\n","        (final_layer_norm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","      )\n","    )\n","    (layernorm_embedding): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","  )\n","  (decoder): BartDecoder(\n","    (embed_tokens): BartScaledWordEmbedding(50265, 768, padding_idx=1)\n","    (embed_positions): BartLearnedPositionalEmbedding(1026, 768)\n","    (layers): ModuleList(\n","      (0-5): 6 x BartDecoderLayer(\n","        (self_attn): BartAttention(\n","          (k_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (v_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (q_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (out_proj): Linear(in_features=768, out_features=768, bias=True)\n","        )\n","        (activation_fn): GELUActivation()\n","        (self_attn_layer_norm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","        (encoder_attn): BartAttention(\n","          (k_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (v_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (q_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (out_proj): Linear(in_features=768, out_features=768, bias=True)\n","        )\n","        (encoder_attn_layer_norm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","        (fc1): Linear(in_features=768, out_features=3072, bias=True)\n","        (fc2): Linear(in_features=3072, out_features=768, bias=True)\n","        (final_layer_norm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","      )\n","    )\n","    (layernorm_embedding): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","  )\n",")\n","1\n","lm_head\n","Linear(in_features=768, out_features=50265, bias=False)\n"]}],"source":["# Randomly initialized NLP model example\n","name = \"facebook/bart-base\"\n","config = AutoConfig.from_pretrained(name)\n","model = AutoModelForSeq2SeqLM.from_config(config)\n","\n","print(inputs)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)"],"id":"kw0Bfkuk2CoI"},{"cell_type":"markdown","metadata":{"id":"fuacUFK72CoI"},"source":["## 5. Vision transformer models\n","\n","These models are all transformer-based computer vision models, but they do **not** all work in exactly the same way.\n","\n","A useful progression for students is:\n","\n","- **ViT**: the basic idea of turning an image into patches and feeding them to a transformer\n","- **DeiT**: a data-efficient training improvement over ViT\n","- **BEiT**: a BERT-like pretraining strategy for images\n","- **Swin Transformer**: a hierarchical vision transformer with local windows\n"],"id":"fuacUFK72CoI"},{"cell_type":"markdown","metadata":{"id":"Q4nSMWWZ2CoI"},"source":["### `google/vit-base-patch16-224`\n","\n","**Main use cases**\n","- Image classification\n","- Visual feature extraction\n","- Starting point for understanding vision transformers\n","\n","**How it works**\n","- ViT splits the image into fixed-size patches, such as **16 x 16** patches.\n","- Each patch is flattened and projected into an embedding.\n","- The sequence of patch embeddings is then processed by a transformer encoder.\n","\n","**Architecture**\n","- **Vision Transformer encoder**\n","- Input resolution: **224 x 224**\n","- Patch size: **16**\n","\n","**Comparison**\n","- This is the most classic vision-transformer baseline.\n","- It plays a role in vision similar to what BERT plays in NLP: a standard reference model.\n","- Unlike CNNs, it processes patch tokens with self-attention instead of convolution.\n"],"id":"Q4nSMWWZ2CoI"},{"cell_type":"markdown","metadata":{"id":"_8tS_6IP2CoI"},"source":["### `facebook/deit-base-patch16-224`\n","\n","**Main use cases**\n","- Image classification\n","- Stronger ViT-style training under limited data or compute\n","\n","**How it works**\n","- DeiT stands for **Data-efficient Image Transformers**.\n","- Architecturally it is close to ViT.\n","- Its main idea is improved training, especially knowledge distillation and data-efficient training strategies.\n","\n","**Architecture**\n","- **Vision Transformer encoder**\n","- Input resolution: **224 x 224**\n","- Patch size: **16**\n","\n","**Comparison**\n","- Very similar to ViT in architecture.\n","- A useful mental model is: **DeiT = ViT trained more efficiently**.\n"],"id":"_8tS_6IP2CoI"},{"cell_type":"markdown","metadata":{"id":"M-92eHuM2CoI"},"source":["### `microsoft/beit-base-patch16-224`\n","\n","**Main use cases**\n","- Image classification\n","- Representation learning\n","- Good for students wanting to connect vision transformers with BERT-style ideas\n","\n","**How it works**\n","- BEiT stands for **Bidirectional Encoder representation from Image Transformers**.\n","- It uses a BERT-like masked-image modeling style for pretraining.\n","- Instead of predicting missing text tokens, it predicts visual tokens for masked image patches.\n","\n","**Architecture**\n","- **Vision Transformer encoder**\n","- Input resolution: **224 x 224**\n","- Patch size: **16**\n","\n","**Comparison**\n","- Conceptually closer to BERT than plain ViT is.\n","- A good mental model is: **BEiT = BERT-style pretraining for images**.\n"],"id":"M-92eHuM2CoI"},{"cell_type":"markdown","metadata":{"id":"e6pXoFK52CoI"},"source":["### `microsoft/swin-tiny-patch4-window7-224`\n","\n","**Main use cases**\n","- Image classification\n","- Dense vision tasks such as detection and segmentation after adaptation\n","- More scalable vision transformer design\n","\n","**How it works**\n","- Swin Transformer uses **shifted local windows** instead of global attention over all patches at every layer.\n","- It is **hierarchical**, meaning feature maps are progressively merged into coarser stages.\n","\n","**Architecture**\n","- **Hierarchical vision transformer**\n","- Patch size: **4**\n","- Window size: **7**\n","- Input resolution: **224 x 224**\n","\n","**Comparison**\n","- Unlike ViT/DeiT/BEiT, Swin is hierarchical and more like CNN backbones in multiscale structure.\n","- It is often more natural for detection/segmentation pipelines than plain ViT.\n"],"id":"e6pXoFK52CoI"},{"cell_type":"markdown","metadata":{"id":"ECB44CO32CoI"},"source":["## 6. Vision transformers vs familiar NLP transformers\n","\n","### Similarities\n","- They still use transformer blocks with attention and MLP layers.\n","- They turn inputs into token sequences.\n","- They learn contextual representations through self-attention.\n","\n","### Differences\n","- NLP transformers tokenize **words/subwords**.\n","- Vision transformers tokenize **image patches**.\n","- ViT-like models usually use image processors instead of text tokenizers.\n","\n","### Quick intuition\n","- **ViT** is the simplest and most standard image transformer.\n","- **DeiT** is a more training-efficient ViT.\n","- **BEiT** is more BERT-like in pretraining style.\n","- **Swin** is more hierarchical and vision-specific.\n"],"id":"ECB44CO32CoI"},{"cell_type":"markdown","metadata":{"id":"yehkph-N2CoI"},"source":["## 7. Vision transformer loading and toy examples"],"id":"yehkph-N2CoI"},{"cell_type":"code","execution_count":7,"metadata":{"id":"4DO1Mq5I2CoI","colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["88435def0598456dbe6a358cf28ededc","d80556eb321b4ed5bbfce46617826bcf","d5df0856579a411394bbd9e252539b67","74b061926d394dff8b6640f7b5eab29b","13d0e05d22ca4e8da4b3f9c90b29c45e","6b8cf97848344a1d80a66155926d38df","f79baf807e774d3b9154d535640d4584","ae3c907b4230488c8ecd95a4aeb31eba","f40cc1cba2884cd4bd64f12bc980e305","3d73d12220f84e1abdf39e836223c407","3ebfa4a3580840ba849b96a34c21e3d3","32e1e5a19bdb47e59c89bb5998d1e9de","443c5650ddbc4a13aa4c2dc791d7e29e","fdebd904cd3940c5ac3c00665983f839","4881ebc517fa4cebb319720945579bbd","3980560b2d14416b813f61392112df09","1b6c8fe6803e466ca694c9fa043dce09","aaa5438661094c70bfd5c32a45b06be4","767a1fd370904406a3c757ea72d19a80","6893c5de9b5144b290e2ff6d9e746e7f","c2373e8ac37b4ba7875915b6f8cad031","926698f798114395be0ceee65dcaffe6","a459149af0b449d19d66922ef3ca8b10","99a77a1f5aa74605bac1274eba1f9508","0fd3413a5c7043f7bd231ccb5696e5e2","0b70242846bf4c44bb820d2c75e48b64","7529a7f2c7744e38b249064171da16a2","9771f00ede8e4ef08635273185563335","6a9eeeffefc3487584aeda9a271ead14","6fb6031a578849209587c057807b2d6f","28055acc6425410ea5ff979f5d3ba976","3aaa557628a9489581891f4d374976fd","3cde29c06a224550bc3f948d858c3088","0bf42ad077314e75856258986703d7d9","79ae523437c64955981beef0db48dea8","9374c28068c74426b0ddf98e18196e9a","67e524cb31444c57832f5d93a77181e8","8018406d6ffe4e839a86b404a63a5730","b06f07af94944ba49f4f49f4e5e9e5c3","09626506044543ce91af99f8a174ce2c","5ef8a18f30ab4275a00afe720d418a9a","ecde06457f92492ab6394171fb003b8e","0b625dc49baf447d9f16da326128704e","e89978d6affa4dcdab6b31c7716b91fb"]},"executionInfo":{"status":"ok","timestamp":1774139134323,"user_tz":240,"elapsed":5670,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"fccd4233-318d-41cd-9adb-3284646e8677"},"outputs":[{"output_type":"display_data","data":{"text/plain":["preprocessor_config.json:   0%|          | 0.00/160 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"88435def0598456dbe6a358cf28ededc"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["config.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"32e1e5a19bdb47e59c89bb5998d1e9de"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["Fast image processor class <class 'transformers.models.vit.image_processing_vit_fast.ViTImageProcessorFast'> is available for this model. Using slow image processor class. To use the fast image processor class set `use_fast=True`.\n"]},{"output_type":"display_data","data":{"text/plain":["model.safetensors:   0%|          | 0.00/346M [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"a459149af0b449d19d66922ef3ca8b10"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["Loading weights:   0%|          | 0/198 [00:00<?, ?it/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"0bf42ad077314e75856258986703d7d9"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["ViTModel LOAD REPORT from: google/vit-base-patch16-224\n","Key                 | Status     | \n","--------------------+------------+-\n","classifier.bias     | UNEXPECTED | \n","classifier.weight   | UNEXPECTED | \n","pooler.dense.weight | MISSING    | \n","pooler.dense.bias   | MISSING    | \n","\n","Notes:\n","- UNEXPECTED\t:can be ignored when loading from different task/architecture; not ok if you expect identical arch.\n","- MISSING\t:those params were newly initialized because missing from the checkpoint. Consider training on your downstream task.\n"]},{"output_type":"stream","name":"stdout","text":["{'pixel_values': tensor([[[[-0.8588, -0.8667, -0.8431,  ..., -0.8039, -0.7961, -0.8824],\n","          [-0.8902, -0.8667, -0.8510,  ..., -0.7882, -0.8196, -0.9137],\n","          [-0.8745, -0.8745, -0.8745,  ..., -0.7647, -0.8353, -0.8824],\n","          ...,\n","          [ 0.5608,  0.5608,  0.4902,  ...,  0.6549,  0.6863,  0.6784],\n","          [ 0.4980,  0.5608,  0.5451,  ...,  0.6706,  0.6627,  0.6706],\n","          [ 0.5765,  0.5686,  0.5843,  ...,  0.6941,  0.6235,  0.6000]],\n","\n","         [[-0.8510, -0.8510, -0.8196,  ..., -0.6784, -0.6471, -0.7176],\n","          [-0.8824, -0.8431, -0.8275,  ..., -0.6706, -0.6706, -0.7490],\n","          [-0.8667, -0.8588, -0.8510,  ..., -0.6549, -0.6941, -0.7255],\n","          ...,\n","          [ 0.3882,  0.3961,  0.3333,  ...,  0.7098,  0.7412,  0.7333],\n","          [ 0.3176,  0.3882,  0.3882,  ...,  0.7255,  0.7176,  0.7255],\n","          [ 0.3882,  0.3882,  0.4196,  ...,  0.7490,  0.6784,  0.6549]],\n","\n","         [[-0.8980, -0.9137, -0.8902,  ..., -0.6863, -0.6784, -0.7725],\n","          [-0.9294, -0.9059, -0.8980,  ..., -0.6627, -0.6941, -0.7961],\n","          [-0.9137, -0.9216, -0.9216,  ..., -0.6235, -0.6863, -0.7490],\n","          ...,\n","          [ 0.0745,  0.0902,  0.0431,  ...,  0.5843,  0.6157,  0.6000],\n","          [ 0.0196,  0.0902,  0.0980,  ...,  0.5922,  0.5765,  0.5843],\n","          [ 0.0902,  0.0980,  0.1294,  ...,  0.6157,  0.5373,  0.5137]]]])}\n","0\n","embeddings\n","ViTEmbeddings(\n","  (patch_embeddings): ViTPatchEmbeddings(\n","    (projection): Conv2d(3, 768, kernel_size=(16, 16), stride=(16, 16))\n","  )\n","  (dropout): Dropout(p=0.0, inplace=False)\n",")\n","1\n","encoder\n","ViTEncoder(\n","  (layer): ModuleList(\n","    (0-11): 12 x ViTLayer(\n","      (attention): ViTAttention(\n","        (attention): ViTSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=True)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","        )\n","        (output): ViTSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): ViTIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): ViTOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","  )\n",")\n","2\n","layernorm\n","LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","3\n","pooler\n","ViTPooler(\n","  (dense): Linear(in_features=768, out_features=768, bias=True)\n","  (activation): Tanh()\n",")\n","ViT last_hidden_state shape: torch.Size([1, 197, 768])\n"]}],"source":["from PIL import Image\n","import requests\n","from transformers import AutoImageProcessor, AutoModel, AutoModelForImageClassification\n","\n","image_url = \"https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/beignets-task-guide.png\"\n","image = Image.open(requests.get(image_url, stream=True).raw)\n","\n","name = \"google/vit-base-patch16-224\"\n","processor = AutoImageProcessor.from_pretrained(name)\n","model = AutoModel.from_pretrained(name)\n","\n","inputs = processor(images=image, return_tensors=\"pt\")\n","\n","print(inputs)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)\n","\n","with torch.no_grad():\n","    outputs = model(**inputs)\n","\n","print(\"ViT last_hidden_state shape:\", outputs.last_hidden_state.shape)\n"],"id":"4DO1Mq5I2CoI"},{"cell_type":"code","execution_count":8,"metadata":{"id":"1WcQxm812CoI","colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["975b22a97c184b58a3ba4359262b09a8","525146832e294969b8bdc703bfddf883","25677a00898c41d88243eedf8dbe8c3e","f625138870cd40f0b1cadb63daa32636","621cc4a079fe4f10b85ab05f1765561f","7da5c91c8ebd41e7a35230e7271b3a92","a2e6ef3e6b6a4b0bba72c87be0181ba2","b8234ca7f55347009b8ea4240377d91e","721cf8f059d14fba92ed78ba9757841c","976eb7d033f648c5a4a1235dd00a6aea","6424d5d3dac847e4b4c8783416c2628a","78930ddac6804ee384a4d23a88bb6494","cd9e62c3b44641878a4858433a25fe31","5f495b8f83874677bf7b642bb609561d","aa269ff988ef4c4bbbe514350fbd793f","c806158f6c4d4a7db8aed6b8dfc1904c","20d6ed2c4bf741c39ca3b3ad979fcfb9","d958f99b43054ed6b2f17849182a874e","9e0a58ad3b324c678d98bb886b858dde","75e154e76dac405faec5ff4b4c3c5a75","5650e6d8b6814fd5b6b418a3a2ec296f","71b54d935c6a4037a10378b0f62726d9","e997f842b2c0400f870dac3a72ba959c","5de95ee692a14b6bb881b41932b291b3","5bcec994291a4f75b178a798a0358833","4d3a2a716a954a98aa03d94a59291f19","11f54c2d605140058b85fb17fbc62308","90c3e5d4ba54402cbd70ce89164dc0d4","2940f038479d4bdcacbf19d548ece814","d7c9b5955d35408f83dfd97d75b6be6e","724b00668d884c5b9870f8aaeabfa993","7aaf8b4ede874df6a5d9483eff9903c3","bc0ba910691b4b19a4a28260bda1bb5b","caaefa4f6ed04b63923464bd14205406","2e18161b4488400e8d7a20dd1eae78fc","00fc7ea916b6498ba219d3c76b0bf6fc","fc43b2ca8e5f4e05a0963ca5b7498e83","bef40506b7854835a5438d6e10e3899f","1f49957b991b4ef1a609d5e47f354efe","120a2dc1b81b457eb024ecdcd1ad4119","f3f29575b3e8477fa5b33936fdfb2b20","f500c8b5fd774f449071eb6a40986584","60c318ffc1cb491c91ccef001ac07659","13473d999c644cfeadd030b2f4c95586","1b02ffebb8354bd0b00edfdc2fcbb136","fd4ee910e32e441c817ec6d70022ce20","ff2c5d60b9274ed481b10d60a18cb0db","70b50b9ad447458ea286c95e676fb846","147f1008718a48aa837a5f7a1d497c1e","504af4c64d964484b17fe27f556946bc","80ad6aa57f6244e8b91cb7c07ff5a2d1","0634c4c5a9cd4318b1b3dde6850be85e","c6a3150c2fe64324afaaa43ab2509649","b18336bd48054725a0f8a8d25d8dde70","1572e0e1a6a74be1b663a7b9b8ab5d8d"]},"executionInfo":{"status":"ok","timestamp":1774139140362,"user_tz":240,"elapsed":6038,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"6d8dd91c-def7-455a-d899-2913647fec00"},"outputs":[{"output_type":"display_data","data":{"text/plain":["preprocessor_config.json:   0%|          | 0.00/160 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"975b22a97c184b58a3ba4359262b09a8"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["config.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"78930ddac6804ee384a4d23a88bb6494"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["Fast image processor class <class 'transformers.models.vit.image_processing_vit_fast.ViTImageProcessorFast'> is available for this model. Using slow image processor class. To use the fast image processor class set `use_fast=True`.\n"]},{"output_type":"display_data","data":{"text/plain":["pytorch_model.bin:   0%|          | 0.00/346M [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"e997f842b2c0400f870dac3a72ba959c"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["Loading weights:   0%|          | 0/200 [00:00<?, ?it/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"caaefa4f6ed04b63923464bd14205406"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["model.safetensors:   0%|          | 0.00/346M [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"1b02ffebb8354bd0b00edfdc2fcbb136"}},"metadata":{}},{"output_type":"stream","name":"stdout","text":["{'pixel_values': tensor([[[[-0.8588, -0.8667, -0.8431,  ..., -0.8039, -0.7961, -0.8824],\n","          [-0.8902, -0.8667, -0.8510,  ..., -0.7882, -0.8196, -0.9137],\n","          [-0.8745, -0.8745, -0.8745,  ..., -0.7647, -0.8353, -0.8824],\n","          ...,\n","          [ 0.5608,  0.5608,  0.4902,  ...,  0.6549,  0.6863,  0.6784],\n","          [ 0.4980,  0.5608,  0.5451,  ...,  0.6706,  0.6627,  0.6706],\n","          [ 0.5765,  0.5686,  0.5843,  ...,  0.6941,  0.6235,  0.6000]],\n","\n","         [[-0.8510, -0.8510, -0.8196,  ..., -0.6784, -0.6471, -0.7176],\n","          [-0.8824, -0.8431, -0.8275,  ..., -0.6706, -0.6706, -0.7490],\n","          [-0.8667, -0.8588, -0.8510,  ..., -0.6549, -0.6941, -0.7255],\n","          ...,\n","          [ 0.3882,  0.3961,  0.3333,  ...,  0.7098,  0.7412,  0.7333],\n","          [ 0.3176,  0.3882,  0.3882,  ...,  0.7255,  0.7176,  0.7255],\n","          [ 0.3882,  0.3882,  0.4196,  ...,  0.7490,  0.6784,  0.6549]],\n","\n","         [[-0.8980, -0.9137, -0.8902,  ..., -0.6863, -0.6784, -0.7725],\n","          [-0.9294, -0.9059, -0.8980,  ..., -0.6627, -0.6941, -0.7961],\n","          [-0.9137, -0.9216, -0.9216,  ..., -0.6235, -0.6863, -0.7490],\n","          ...,\n","          [ 0.0745,  0.0902,  0.0431,  ...,  0.5843,  0.6157,  0.6000],\n","          [ 0.0196,  0.0902,  0.0980,  ...,  0.5922,  0.5765,  0.5843],\n","          [ 0.0902,  0.0980,  0.1294,  ...,  0.6157,  0.5373,  0.5137]]]])}\n","0\n","vit\n","ViTModel(\n","  (embeddings): ViTEmbeddings(\n","    (patch_embeddings): ViTPatchEmbeddings(\n","      (projection): Conv2d(3, 768, kernel_size=(16, 16), stride=(16, 16))\n","    )\n","    (dropout): Dropout(p=0.0, inplace=False)\n","  )\n","  (encoder): ViTEncoder(\n","    (layer): ModuleList(\n","      (0-11): 12 x ViTLayer(\n","        (attention): ViTAttention(\n","          (attention): ViTSelfAttention(\n","            (query): Linear(in_features=768, out_features=768, bias=True)\n","            (key): Linear(in_features=768, out_features=768, bias=True)\n","            (value): Linear(in_features=768, out_features=768, bias=True)\n","          )\n","          (output): ViTSelfOutput(\n","            (dense): Linear(in_features=768, out_features=768, bias=True)\n","            (dropout): Dropout(p=0.0, inplace=False)\n","          )\n","        )\n","        (intermediate): ViTIntermediate(\n","          (dense): Linear(in_features=768, out_features=3072, bias=True)\n","          (intermediate_act_fn): GELUActivation()\n","        )\n","        (output): ViTOutput(\n","          (dense): Linear(in_features=3072, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","        (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","        (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      )\n","    )\n","  )\n","  (layernorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n",")\n","1\n","classifier\n","Linear(in_features=768, out_features=1000, bias=True)\n","Predicted label: espresso\n"]}],"source":["# Toy example: image classification with DeiT\n","\n","from transformers import AutoImageProcessor, AutoModelForImageClassification\n","\n","name = \"facebook/deit-base-patch16-224\"\n","processor = AutoImageProcessor.from_pretrained(name)\n","model = AutoModelForImageClassification.from_pretrained(name)\n","\n","inputs = processor(images=image, return_tensors=\"pt\")\n","\n","print(inputs)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)\n","\n","with torch.no_grad():\n","    outputs = model(**inputs)\n","\n","predicted_class_id = outputs.logits.argmax(-1).item()\n","print(\"Predicted label:\", model.config.id2label[predicted_class_id])\n"],"id":"1WcQxm812CoI"},{"cell_type":"code","execution_count":9,"metadata":{"id":"uHPWQPh92CoI","colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["f7746b359b1f4992bcdabf000352dcef","313b32259b7344b1bc8f94e96a7d7732","f63344aed05c497a9066ea42f566cbc0","d631c50477054aaaa5fb47b58c208d84","22f90aeae74a4bacbdb43f7ffe18918f","bebe42fbd6d747be890259410498f0d8","438a03f02777481ca0e802e84258c8b0","eb1a074da83d449bb1d7ef52065d8594","f5b23b93cdde4667b9bfaf05684922c5","59c18aec266147189fffe9fdef70e05b","260ec963c879422f960c98e82bb8ce5b","83c08c4b4e0340d8b27f801d24287ab5","f67781a725e34c2fb753995b320ae5f1","7dfb2c4103c245e3b5ab000895c2c844","4dc025bc2ac74e51ae11bdea2aa18ca6","a789e7820fb444c29f14d6b42050e273","5780790bc33641a4ba51925b1aa3c5d5","a0f0efb3868d46c6b2538f6dd2c45151","3fc35c901f7048e1a82109f4c3e03147","d4ca7fac43244406a906490ce302c29a","6e6a59fa13b04c6498f9576c6d272238","1ccd30e408ba42a6b7bdf4fcdde50d25","73559a849694465392b02d4b5e218c30","73f202e37945412a8e779343913d8856","e2ced49b410041b8b2d406c08af723c5","07a810eb852f454a97686414d44f5190","c2fdc21090c94e40b2d116ac5443e52a","73899a4985ae42d5a250aceac8b09d42","08d76879690c450c9e61ffe94ce1a0d3","add82d4490ea4d76bb97c141b3037435","924cbcde6cd34e51869decceba17d483","f79a33aa6757419996eb6fe44bff154a","01f90124952e4f65aa366e4f01fcfbcb","45ed4a10bb3748d19729df977a5bde6d","fc27b7613f6e4ec8af8bc0ac4dfb90fe","6ece9583e7b7477bbb01111e20fb4122","47722e52dbd0447eac2c6059c39b9697","f2963c82b3644b6a9d295cb4f531748b","3ad3abddde5a4829950c20e1e3bbfd4d","e38a2bdef31b4ff28b3151b2253fcdc0","93a25a11b11d4df68ff5418e54a812b1","19b260a455d544f59ebd641fb98ae3dd","8e8e439e7a814b69865270132387ddb5","cd19812e083a46889551c3eb951ec2c7"]},"executionInfo":{"status":"ok","timestamp":1774139149065,"user_tz":240,"elapsed":8699,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"127fe143-987b-4752-b769-98812bbbae58"},"outputs":[{"output_type":"display_data","data":{"text/plain":["preprocessor_config.json:   0%|          | 0.00/276 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"f7746b359b1f4992bcdabf000352dcef"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["The image processor of type `BeitImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. \n"]},{"output_type":"display_data","data":{"text/plain":["config.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"83c08c4b4e0340d8b27f801d24287ab5"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["model.safetensors:   0%|          | 0.00/350M [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"73559a849694465392b02d4b5e218c30"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["Loading weights:   0%|          | 0/221 [00:00<?, ?it/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"45ed4a10bb3748d19729df977a5bde6d"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["BeitModel LOAD REPORT from: microsoft/beit-base-patch16-224\n","Key               | Status     |  | \n","------------------+------------+--+-\n","classifier.bias   | UNEXPECTED |  | \n","classifier.weight | UNEXPECTED |  | \n","\n","Notes:\n","- UNEXPECTED\t:can be ignored when loading from different task/architecture; not ok if you expect identical arch.\n"]},{"output_type":"stream","name":"stdout","text":["{'pixel_values': tensor([[[[-0.8588, -0.8667, -0.8431,  ..., -0.8039, -0.7961, -0.8824],\n","          [-0.8902, -0.8667, -0.8510,  ..., -0.7882, -0.8196, -0.9137],\n","          [-0.8745, -0.8745, -0.8745,  ..., -0.7647, -0.8353, -0.8824],\n","          ...,\n","          [ 0.5608,  0.5608,  0.4902,  ...,  0.6549,  0.6863,  0.6784],\n","          [ 0.4980,  0.5608,  0.5451,  ...,  0.6706,  0.6627,  0.6706],\n","          [ 0.5765,  0.5686,  0.5843,  ...,  0.6941,  0.6235,  0.6000]],\n","\n","         [[-0.8510, -0.8510, -0.8196,  ..., -0.6784, -0.6471, -0.7176],\n","          [-0.8824, -0.8431, -0.8275,  ..., -0.6706, -0.6706, -0.7490],\n","          [-0.8667, -0.8588, -0.8510,  ..., -0.6549, -0.6941, -0.7255],\n","          ...,\n","          [ 0.3882,  0.3961,  0.3333,  ...,  0.7098,  0.7412,  0.7333],\n","          [ 0.3176,  0.3882,  0.3882,  ...,  0.7255,  0.7176,  0.7255],\n","          [ 0.3882,  0.3882,  0.4196,  ...,  0.7490,  0.6784,  0.6549]],\n","\n","         [[-0.8980, -0.9137, -0.8902,  ..., -0.6863, -0.6784, -0.7725],\n","          [-0.9294, -0.9059, -0.8980,  ..., -0.6627, -0.6941, -0.7961],\n","          [-0.9137, -0.9216, -0.9216,  ..., -0.6235, -0.6863, -0.7490],\n","          ...,\n","          [ 0.0745,  0.0902,  0.0431,  ...,  0.5843,  0.6157,  0.6000],\n","          [ 0.0196,  0.0902,  0.0980,  ...,  0.5922,  0.5765,  0.5843],\n","          [ 0.0902,  0.0980,  0.1294,  ...,  0.6157,  0.5373,  0.5137]]]])}\n","0\n","embeddings\n","BeitEmbeddings(\n","  (patch_embeddings): BeitPatchEmbeddings(\n","    (projection): Conv2d(3, 768, kernel_size=(16, 16), stride=(16, 16))\n","  )\n","  (dropout): Dropout(p=0.0, inplace=False)\n",")\n","1\n","encoder\n","BeitEncoder(\n","  (layer): ModuleList(\n","    (0): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): Identity()\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (1): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.00909090880304575)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (2): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.0181818176060915)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (3): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.027272727340459824)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (4): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.036363635212183)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (5): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.045454543083906174)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (6): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.054545458406209946)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (7): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.06363636255264282)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (8): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.0727272778749466)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (9): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.08181818574666977)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (10): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.09090909361839294)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","    (11): BeitLayer(\n","      (attention): BeitAttention(\n","        (attention): BeitSdpaSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=False)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","          (relative_position_bias): BeitRelativePositionBias()\n","        )\n","        (output): BeitSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): BeitIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): BeitOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (drop_path): BeitDropPath(p=0.10000000149011612)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","  )\n",")\n","2\n","layernorm\n","Identity()\n","3\n","pooler\n","BeitPooler(\n","  (layernorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n",")\n","BEiT last_hidden_state shape: torch.Size([1, 197, 768])\n"]}],"source":["# Toy example: BEiT feature extraction\n","\n","name = \"microsoft/beit-base-patch16-224\"\n","processor = AutoImageProcessor.from_pretrained(name)\n","model = AutoModel.from_pretrained(name)\n","\n","inputs = processor(images=image, return_tensors=\"pt\")\n","\n","print(inputs)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)\n","\n","with torch.no_grad():\n","    outputs = model(**inputs)\n","\n","print(\"BEiT last_hidden_state shape:\", outputs.last_hidden_state.shape)\n"],"id":"uHPWQPh92CoI"},{"cell_type":"code","execution_count":10,"metadata":{"id":"BS67pEyr2CoI","colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["12d2b8bd2cd04bb294f8d8bcb55fc553","24818288a3124d22a4b9bb1f70caaeb8","8b8847b98ed24c4db79f58bee7557336","f8ec11b8d776424986637e81cb57cdcf","17357f329a784eb99c61c90ed01a1d31","0309f98ec97643f686f1f7c7953b1490","6a7cc99728274abfbf02020c2f46dde6","de47938d9e1a474993e07ca33eda8609","25855cf62b9e45458bd278e8ccabd039","bead8c7d0d6d4d99bcc3991caf4cdb96","c0eaa3eb7644403ba9448ac925efd56a","2d6aadafc7db47eaa21f3b428db7c7be","e24cc75e7b9f44a19ea2d5e390f74613","efc8b0f56c884bea9b5228978d7e489d","67ddcf15d3b04dff983ed3df1a31e198","1a91b1d560ec4196be3365e6f466fb56","af9496f327c44834bd09972a263caeb4","5b1017a3395848ea80118bcad9dd2db0","a5da3b74406a417d906b6ebb5390d55d","67df1e5f1a91462f8c7f84844a758a1f","bef8fc46775b432eb6a6ab016e0fec78","37529cce09ff48e49556668d1b3e00a1","a77a3c7a4d3d4f2f884b833a6cac8eef","3057883893804b2fbbca149dc28c1d75","db00b68a0af843cf8d915d7fe09521db","f0f17daaf2774e759011f7544033b272","ab27044e403b46228b51e228c50ce1b2","283c74c4bf8f488c8ca41b666dc810bd","5f77fc8f7a06461786f0a820dc58dd64","cade51c580b24342907d49650ba7e76d","7a7ec1e6da554c4eb7c364493de7d2be","c8e55d6dc3a648a38a6ae4b487892404","f49972cd2c234aaca2f399ed5f090bf5","9989f9b0d0444a28af645ecb85448815","53066e400a444debadc2991a018de1bc","2714aebc66af4fd2a7b56fbd7412ad72","bb14653f3d5f45d8805c408206f17502","2177c435c25b47d0ab9ecbb94d0e37da","ee2dc24eb3a0469c8684d235ffe12ab4","9c8c3dfb0d29436cbb73921b1b5a5adf","7f560044381849f9b0230744fb4f49a1","9a3c7e7afe214962bd99caf53c29f5d7","dc3e302063144edc9172968431bdb676","39fa1fa9441a4380ac81aba30dd0299b"]},"executionInfo":{"status":"ok","timestamp":1774139152967,"user_tz":240,"elapsed":3889,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"740fe9b4-1361-4ae3-cd10-515be24d3342"},"outputs":[{"output_type":"display_data","data":{"text/plain":["preprocessor_config.json:   0%|          | 0.00/255 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"12d2b8bd2cd04bb294f8d8bcb55fc553"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["The image processor of type `ViTImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. \n"]},{"output_type":"display_data","data":{"text/plain":["config.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"2d6aadafc7db47eaa21f3b428db7c7be"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["model.safetensors:   0%|          | 0.00/113M [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"a77a3c7a4d3d4f2f884b833a6cac8eef"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["Loading weights:   0%|          | 0/233 [00:00<?, ?it/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"9989f9b0d0444a28af645ecb85448815"}},"metadata":{}},{"output_type":"stream","name":"stdout","text":["{'pixel_values': tensor([[[[-1.8097, -1.8439, -1.7583,  ..., -1.7069, -1.6555, -1.8610],\n","          [-1.8782, -1.8268, -1.7925,  ..., -1.6384, -1.7240, -1.9638],\n","          [-1.8439, -1.8610, -1.8439,  ..., -1.5870, -1.7412, -1.8610],\n","          ...,\n","          [ 1.2728,  1.3242,  1.0844,  ...,  1.4783,  1.5810,  1.5297],\n","          [ 1.1358,  1.2899,  1.2557,  ...,  1.5125,  1.4954,  1.5468],\n","          [ 1.3242,  1.3070,  1.3413,  ...,  1.5810,  1.4098,  1.3584]],\n","\n","         [[-1.7031, -1.7031, -1.6155,  ..., -1.3179, -1.2129, -1.4055],\n","          [-1.7731, -1.6856, -1.6506,  ..., -1.2829, -1.2829, -1.5105],\n","          [-1.7381, -1.7381, -1.7031,  ..., -1.2304, -1.3529, -1.4230],\n","          ...,\n","          [ 1.0455,  1.0980,  0.8880,  ...,  1.7633,  1.8683,  1.8158],\n","          [ 0.8880,  1.0630,  1.0630,  ...,  1.7983,  1.7808,  1.8333],\n","          [ 1.0630,  1.0630,  1.1506,  ...,  1.8683,  1.6933,  1.6408]],\n","\n","         [[-1.5779, -1.6127, -1.5430,  ..., -1.1247, -1.0724, -1.3164],\n","          [-1.6476, -1.5953, -1.5779,  ..., -1.0376, -1.1247, -1.3687],\n","          [-1.6127, -1.6476, -1.6476,  ..., -0.9330, -1.1073, -1.2293],\n","          ...,\n","          [ 0.5659,  0.6356,  0.4614,  ...,  1.6988,  1.7860,  1.7337],\n","          [ 0.4439,  0.6182,  0.6356,  ...,  1.7163,  1.6814,  1.7337],\n","          [ 0.6182,  0.6356,  0.7228,  ...,  1.7860,  1.5942,  1.5420]]]])}\n","0\n","swin\n","SwinModel(\n","  (embeddings): SwinEmbeddings(\n","    (patch_embeddings): SwinPatchEmbeddings(\n","      (projection): Conv2d(3, 96, kernel_size=(4, 4), stride=(4, 4))\n","    )\n","    (norm): LayerNorm((96,), eps=1e-05, elementwise_affine=True)\n","    (dropout): Dropout(p=0.0, inplace=False)\n","  )\n","  (encoder): SwinEncoder(\n","    (layers): ModuleList(\n","      (0): SwinStage(\n","        (blocks): ModuleList(\n","          (0): SwinLayer(\n","            (layernorm_before): LayerNorm((96,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=96, out_features=96, bias=True)\n","                (key): Linear(in_features=96, out_features=96, bias=True)\n","                (value): Linear(in_features=96, out_features=96, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=96, out_features=96, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): Identity()\n","            (layernorm_after): LayerNorm((96,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=96, out_features=384, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=384, out_features=96, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","          (1): SwinLayer(\n","            (layernorm_before): LayerNorm((96,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=96, out_features=96, bias=True)\n","                (key): Linear(in_features=96, out_features=96, bias=True)\n","                (value): Linear(in_features=96, out_features=96, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=96, out_features=96, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.00909090880304575)\n","            (layernorm_after): LayerNorm((96,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=96, out_features=384, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=384, out_features=96, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","        )\n","        (downsample): SwinPatchMerging(\n","          (reduction): Linear(in_features=384, out_features=192, bias=False)\n","          (norm): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","        )\n","      )\n","      (1): SwinStage(\n","        (blocks): ModuleList(\n","          (0): SwinLayer(\n","            (layernorm_before): LayerNorm((192,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=192, out_features=192, bias=True)\n","                (key): Linear(in_features=192, out_features=192, bias=True)\n","                (value): Linear(in_features=192, out_features=192, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=192, out_features=192, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.0181818176060915)\n","            (layernorm_after): LayerNorm((192,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=192, out_features=768, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=768, out_features=192, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","          (1): SwinLayer(\n","            (layernorm_before): LayerNorm((192,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=192, out_features=192, bias=True)\n","                (key): Linear(in_features=192, out_features=192, bias=True)\n","                (value): Linear(in_features=192, out_features=192, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=192, out_features=192, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.027272727340459824)\n","            (layernorm_after): LayerNorm((192,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=192, out_features=768, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=768, out_features=192, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","        )\n","        (downsample): SwinPatchMerging(\n","          (reduction): Linear(in_features=768, out_features=384, bias=False)\n","          (norm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","        )\n","      )\n","      (2): SwinStage(\n","        (blocks): ModuleList(\n","          (0): SwinLayer(\n","            (layernorm_before): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=384, out_features=384, bias=True)\n","                (key): Linear(in_features=384, out_features=384, bias=True)\n","                (value): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.036363635212183)\n","            (layernorm_after): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=384, out_features=1536, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=1536, out_features=384, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","          (1): SwinLayer(\n","            (layernorm_before): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=384, out_features=384, bias=True)\n","                (key): Linear(in_features=384, out_features=384, bias=True)\n","                (value): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.045454543083906174)\n","            (layernorm_after): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=384, out_features=1536, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=1536, out_features=384, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","          (2): SwinLayer(\n","            (layernorm_before): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=384, out_features=384, bias=True)\n","                (key): Linear(in_features=384, out_features=384, bias=True)\n","                (value): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.054545458406209946)\n","            (layernorm_after): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=384, out_features=1536, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=1536, out_features=384, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","          (3): SwinLayer(\n","            (layernorm_before): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=384, out_features=384, bias=True)\n","                (key): Linear(in_features=384, out_features=384, bias=True)\n","                (value): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.06363636255264282)\n","            (layernorm_after): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=384, out_features=1536, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=1536, out_features=384, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","          (4): SwinLayer(\n","            (layernorm_before): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=384, out_features=384, bias=True)\n","                (key): Linear(in_features=384, out_features=384, bias=True)\n","                (value): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.0727272778749466)\n","            (layernorm_after): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=384, out_features=1536, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=1536, out_features=384, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","          (5): SwinLayer(\n","            (layernorm_before): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=384, out_features=384, bias=True)\n","                (key): Linear(in_features=384, out_features=384, bias=True)\n","                (value): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=384, out_features=384, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.08181818574666977)\n","            (layernorm_after): LayerNorm((384,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=384, out_features=1536, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=1536, out_features=384, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","        )\n","        (downsample): SwinPatchMerging(\n","          (reduction): Linear(in_features=1536, out_features=768, bias=False)\n","          (norm): LayerNorm((1536,), eps=1e-05, elementwise_affine=True)\n","        )\n","      )\n","      (3): SwinStage(\n","        (blocks): ModuleList(\n","          (0): SwinLayer(\n","            (layernorm_before): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=768, out_features=768, bias=True)\n","                (key): Linear(in_features=768, out_features=768, bias=True)\n","                (value): Linear(in_features=768, out_features=768, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=768, out_features=768, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.09090909361839294)\n","            (layernorm_after): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=768, out_features=3072, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=3072, out_features=768, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","          (1): SwinLayer(\n","            (layernorm_before): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","            (attention): SwinAttention(\n","              (self): SwinSelfAttention(\n","                (query): Linear(in_features=768, out_features=768, bias=True)\n","                (key): Linear(in_features=768, out_features=768, bias=True)\n","                (value): Linear(in_features=768, out_features=768, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","              (output): SwinSelfOutput(\n","                (dense): Linear(in_features=768, out_features=768, bias=True)\n","                (dropout): Dropout(p=0.0, inplace=False)\n","              )\n","            )\n","            (drop_path): SwinDropPath(p=0.10000000149011612)\n","            (layernorm_after): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","            (intermediate): SwinIntermediate(\n","              (dense): Linear(in_features=768, out_features=3072, bias=True)\n","              (intermediate_act_fn): GELUActivation()\n","            )\n","            (output): SwinOutput(\n","              (dense): Linear(in_features=3072, out_features=768, bias=True)\n","              (dropout): Dropout(p=0.0, inplace=False)\n","            )\n","          )\n","        )\n","      )\n","    )\n","  )\n","  (layernorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","  (pooler): AdaptiveAvgPool1d(output_size=1)\n",")\n","1\n","classifier\n","Linear(in_features=768, out_features=1000, bias=True)\n","Predicted label: eggnog\n"]}],"source":["# Toy example: Swin image classification\n","\n","name = \"microsoft/swin-tiny-patch4-window7-224\"\n","processor = AutoImageProcessor.from_pretrained(name)\n","model = AutoModelForImageClassification.from_pretrained(name)\n","\n","inputs = processor(images=image, return_tensors=\"pt\")\n","\n","print(inputs)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)\n","\n","with torch.no_grad():\n","    outputs = model(**inputs)\n","\n","predicted_class_id = outputs.logits.argmax(-1).item()\n","print(\"Predicted label:\", model.config.id2label[predicted_class_id])\n"],"id":"BS67pEyr2CoI"},{"cell_type":"code","execution_count":11,"metadata":{"id":"Pce__SsG2CoI","colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"status":"ok","timestamp":1774139154380,"user_tz":240,"elapsed":1403,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"2f1f30c1-cb87-474c-8ad6-c0817abe039e"},"outputs":[{"output_type":"stream","name":"stdout","text":["0\n","embeddings\n","ViTEmbeddings(\n","  (patch_embeddings): ViTPatchEmbeddings(\n","    (projection): Conv2d(3, 768, kernel_size=(16, 16), stride=(16, 16))\n","  )\n","  (dropout): Dropout(p=0.0, inplace=False)\n",")\n","1\n","encoder\n","ViTEncoder(\n","  (layer): ModuleList(\n","    (0-11): 12 x ViTLayer(\n","      (attention): ViTAttention(\n","        (attention): ViTSelfAttention(\n","          (query): Linear(in_features=768, out_features=768, bias=True)\n","          (key): Linear(in_features=768, out_features=768, bias=True)\n","          (value): Linear(in_features=768, out_features=768, bias=True)\n","        )\n","        (output): ViTSelfOutput(\n","          (dense): Linear(in_features=768, out_features=768, bias=True)\n","          (dropout): Dropout(p=0.0, inplace=False)\n","        )\n","      )\n","      (intermediate): ViTIntermediate(\n","        (dense): Linear(in_features=768, out_features=3072, bias=True)\n","        (intermediate_act_fn): GELUActivation()\n","      )\n","      (output): ViTOutput(\n","        (dense): Linear(in_features=3072, out_features=768, bias=True)\n","        (dropout): Dropout(p=0.0, inplace=False)\n","      )\n","      (layernorm_before): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","      (layernorm_after): LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","    )\n","  )\n",")\n","2\n","layernorm\n","LayerNorm((768,), eps=1e-12, elementwise_affine=True)\n","3\n","pooler\n","ViTPooler(\n","  (dense): Linear(in_features=768, out_features=768, bias=True)\n","  (activation): Tanh()\n",")\n"]}],"source":["# Randomly initialized vision transformer example\n","\n","name = \"google/vit-base-patch16-224\"\n","config = AutoConfig.from_pretrained(name)\n","model = AutoModel.from_config(config)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)\n"],"id":"Pce__SsG2CoI"},{"cell_type":"markdown","metadata":{"id":"KxprFjWS2CoI"},"source":["## 8. CLIP models\n","\n","CLIP is different from the previous vision models because it is **multimodal**.\n","\n","Instead of only understanding images, CLIP learns to connect:\n","- **images**\n","- **text**\n","\n","This makes it very useful for:\n","- zero-shot image classification\n","- image-text retrieval\n","- matching captions to images\n","- building multimodal applications\n"],"id":"KxprFjWS2CoI"},{"cell_type":"markdown","metadata":{"id":"iggPwVSo2CoI"},"source":["### `openai/clip-vit-base-patch16`\n","\n","**Main use cases**\n","- Image-text matching\n","- Zero-shot image classification\n","- Retrieval\n","\n","**How it works**\n","- CLIP has an image encoder and a text encoder.\n","- It maps images and texts into a shared embedding space.\n","- Similar image-text pairs should have embeddings that are close.\n","\n","**Architecture**\n","- **Dual-encoder multimodal model**\n","- Vision encoder uses a ViT backbone with patch size **16**\n","\n","**Comparison**\n","- Unlike ordinary ViT models, CLIP also includes a text encoder.\n","- Unlike BERT or GPT, its main goal is multimodal alignment rather than pure language modeling.\n"],"id":"iggPwVSo2CoI"},{"cell_type":"markdown","metadata":{"id":"nAkRj14R2CoI"},"source":["### `openai/clip-vit-base-patch32`\n","\n","**Main use cases**\n","- Same use cases as other CLIP models\n","- Useful for image-text similarity and zero-shot classification\n","\n","**How it works**\n","- Same CLIP idea: jointly embed text and images.\n","- Uses a ViT image encoder with patch size **32**.\n","\n","**Architecture**\n","- **Dual-encoder multimodal model**\n","\n","**Comparison**\n","- Same family as CLIP patch16, but the patch size differs.\n"],"id":"nAkRj14R2CoI"},{"cell_type":"markdown","metadata":{"id":"mWzCwdbG2CoI"},"source":["### `openai/clip-vit-large-patch14`\n","\n","**Main use cases**\n","- Stronger zero-shot image classification\n","- Better image-text retrieval\n","\n","**How it works**\n","- Same CLIP training idea, but with a larger vision transformer.\n","\n","**Architecture**\n","- **Dual-encoder multimodal model**\n","- Larger than the base variants\n","- Patch size **14**\n","\n","**Comparison**\n","- Same CLIP family, but larger capacity.\n"],"id":"mWzCwdbG2CoI"},{"cell_type":"markdown","metadata":{"id":"X-Y4DxJU2CoJ"},"source":["### `openai/clip-vit-large-patch14-336`\n","\n","**Main use cases**\n","- Strong image-text alignment\n","- Better use of higher-resolution images\n","- Zero-shot classification with higher input resolution\n","\n","**How it works**\n","- Same CLIP concept as the previous model.\n","- This version is designed around **336 x 336** image inputs.\n","\n","**Architecture**\n","- **Dual-encoder multimodal model**\n","- Large ViT image encoder\n","- Higher input resolution\n","\n","**Comparison**\n","- Similar to `openai/clip-vit-large-patch14`, but intended for higher-resolution processing.\n"],"id":"X-Y4DxJU2CoJ"},{"cell_type":"markdown","metadata":{"id":"YMwhM7a_2CoJ"},"source":["## 9. CLIP vs ViT vs BERT/GPT/T5\n","\n","### CLIP vs ordinary vision transformers\n","- ViT/DeiT/BEiT/Swin are usually used directly for image tasks.\n","- CLIP learns a **shared image-text space**.\n","\n","### CLIP vs BERT/GPT/T5\n","- BERT is text-only understanding.\n","- GPT is text-only generation.\n","- T5 is text-to-text.\n","- CLIP is primarily **image-text alignment**, not standard text generation.\n","\n","### Why CLIP is so useful\n","It lets you classify images using natural-language labels, for example:\n","- `\"a photo of a cat\"`\n","- `\"a photo of a dog\"`\n","\n","without training a separate classifier head in the usual way.\n"],"id":"YMwhM7a_2CoJ"},{"cell_type":"markdown","metadata":{"id":"orpja2rA2CoM"},"source":["## 10. CLIP loading and toy examples"],"id":"orpja2rA2CoM"},{"cell_type":"code","execution_count":12,"metadata":{"id":"Y5DHJjoe2CoM","colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["149852e4bbd24e9aae020e5f2ed66981","bded29baaf6242a1960e03c5134a1139","cad425a29a214cf1adcf15eddd25dffb","ebc4e94fcfbb4445824730f9824e8d3f","0c403fb7cb8a4b3e9b9a339f7f199cec","097a9e98cd3a4d5bb34c2d68ec942aea","dcf12befaab848b993cdfe1f0f495f0b","919168cb2cfe4478a16b670929bba1bf","e63124aa19044203837db098ec240f2b","a369a5dac1fc418ebf0f9d92a0b79397","0b07e4329d544540becd53010d06b04e","9e6686baecb04e0f8e791bc10c7c5346","48be8da5bd604dd8bb37c7e5a7eddb35","ce48f53cdbb64fec83f38fe25f10e63c","cb9a8514bc5f43fa818d91a88efeba9b","8a5c6724d5244f2ca70a107ae16b9a34","40f6a95e774041dbb7573d4f9f902442","d803e50763c84a34a441c6445a13dd29","234d64de30c64c75b63a948632a4b40a","15e417faf04544e2a7f8d91d81bd774c","45868a16040b4001aa2dc09fd14b74b1","2551c5b57acf4e9e8d3bfd888aed8d66","4ec391893079442f8c9cc864203b2e4c","2f8487ce28b541ae97c878e191eacf20","39b56994f91147bdba66a67fc10d3066","284a0684b315482fa0d35a4275925533","3f128d7331cb4feebc43b00c8d599879","a62d1e65550f4ebaab6e5dffbf6c6f0c","b24961bc4bbc4430b7690873475d694f","4e8b39d54cc34696b2036f9c43a0125e","f3c6ff21761d46439ce54edf69f36481","3979a4e086ab4903b57b81d8024784d4","42545e2506c749279fff3cebe9e88ec2","56abd0778f7e4f6295e178a53d398d17","a51dfc5457b14746ab9b2f1a4740605f","f1742abe580b4121b9abf3ed8d7f1a65","f8152e5491f746efb088a7f0f84cd6d9","1a3a7b9551c146c78725150b2aeaf235","a393f43fb57f4945a3279df9025895fd","97ee9d75477d472f84eb08f84699dcd8","353927350d5d408590cbbe743fc7174a","35597e7f9b9d434d83ea87004f59b6f0","84f3a4dd7aa84d62b87c18b8dd72e261","01e9f3cf3cf146b1be521a4a6697fc5b","951425f2c1c2460185e4cd76660e74a0","d7bd5d786245445b9af6a8de5a874267","7551b7030bc64e428c3d8262c0fe2b0e","7ceb50bb60fa4774b6198a932f0fc26c","f55881b0d3144e08b8cf1b97a04ff003","a9a95224c44641acb058d197b0fa2def","1e4bfc3b8e1e443a980a72647469b4a5","0592f35fef324bca830b8cf7790b7a96","abe32e47fa934848b3048e7385134613","3552f62828e44b8bbd3c27ee875d49d2","a3a63f7d493e40538fc8c5aa74e4d407","cc536d9a2b964a5d95085e85ee457611","ba06f2c6721248d9bc8630155282ab54","f091f86ce34946e6b1b1162c0b8cae1d","bae880cba62945409c4a5b6f9f1ca203","bf6a960802ad4680baea46531e863b57","fa9d0c61175646df9b63d2581bcaa132","404d2958e98b4844b8a786ed5162a76f","28ccdcf822374f788845e03f22c6fbd0","450530a6b9984868a9ca958abcc4930b","c07ba48d652f48ac9ad34ff41bd217de","1304fc77a54f4dc7b90e2b736e9c3716","6cc3534833b44dccb647b8cf90217b7b","5ad0ff4146e444b8b84ccf88d2297b87","d19f5e1bffe74555ae3cd75ab097a976","1201f03877834b78bd73eb87be4ed32b","21b46398805549d6bcd0edb5f7ea1f6d","dfe451d787db442da00113f11da30538","cd741aeecbdd4c6ba7efc1593c7724eb","2774440c72c94b9581d4af81e56ad712","8ba33d1dcbb64497814ca20405a88a24","6cce18d36ce04c3c91cf6de3103bed67","c2c6a8a863f14db58ee64fef79a0bc64","a92c097be89f4fd697a15d3c0eaff120","273c2dd69ae5492d812eec1547dd06e4","ec5585ef887c4df28e01e9de8ee5b763","a3ae59edb5d04655ab082ddf747210a6","0f39295c6f18442f8c4f5438236b8cc2","61711af3c604407299e8e2b0d22152bd","150b75d4f25940da8764c669b59c3740","04960b20833e4dc1af60e75c6465214a","5249ad1244f14ce1adeb5f42cb21fe45","5e46ed156b154dca830ac66f1718b659","2e3147442ba8411581879ddc19c5b560","19d6e616c847432ba4b605f303692c98","f1da0c7e52e04b8c9842618de31e146c","aaa8089bcbf64c858f9e8204ba1e7d47","f5a38435917a4ea9a03336a500a2111d","f8178c307f584ae688182465941523bc","0f18d3deecfc47d0bc4b6d93e5a51475","167d7b9b27894d21b523d68f159428d5","54810d2290da4c90ae062b5e36b704f1","5f76c5ed58b64f58b9d4e3fc3d62eb74","e5ce1d1e14834ef68ecc80c05a72fca6","999c5898956549bfbc88869bcaef60fe","64c6e6d9bf6248358acc46e87b333c04","f52b6aa644cb42e9ba724dba9b5d0484","69e2230c2a0f4502b20cf2d2a1ca63c4","1541d7bb03f04678b9b21a69ba768989","0314147546b54e75b1f951ab81b2d538","a1defcba2bda4bf29a6d39eabe759049","675bca77918646b5bce709210c569513","c508178e4155427fb1e22152cb6a4926","70356188c49743bb9834fc04dc6334b0","377d5d30d4d74c8992559d652ab14c13","8efa61f9b3eb42c5a6648a1fe5d0762a"]},"executionInfo":{"status":"ok","timestamp":1774139166320,"user_tz":240,"elapsed":11938,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"b59370ee-7d80-4a1d-f10a-7227cab42844"},"outputs":[{"output_type":"display_data","data":{"text/plain":["preprocessor_config.json:   0%|          | 0.00/316 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"149852e4bbd24e9aae020e5f2ed66981"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["tokenizer_config.json:   0%|          | 0.00/592 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"9e6686baecb04e0f8e791bc10c7c5346"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["config.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"4ec391893079442f8c9cc864203b2e4c"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["The image processor of type `CLIPImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. \n"]},{"output_type":"display_data","data":{"text/plain":["vocab.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"56abd0778f7e4f6295e178a53d398d17"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["merges.txt: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"951425f2c1c2460185e4cd76660e74a0"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["tokenizer.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"cc536d9a2b964a5d95085e85ee457611"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["special_tokens_map.json:   0%|          | 0.00/389 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"6cc3534833b44dccb647b8cf90217b7b"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["pytorch_model.bin:   0%|          | 0.00/605M [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"a92c097be89f4fd697a15d3c0eaff120"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["model.safetensors:   0%|          | 0.00/605M [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"19d6e616c847432ba4b605f303692c98"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["Loading weights:   0%|          | 0/398 [00:00<?, ?it/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"64c6e6d9bf6248358acc46e87b333c04"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["CLIPModel LOAD REPORT from: openai/clip-vit-base-patch32\n","Key                                  | Status     |  | \n","-------------------------------------+------------+--+-\n","text_model.embeddings.position_ids   | UNEXPECTED |  | \n","vision_model.embeddings.position_ids | UNEXPECTED |  | \n","\n","Notes:\n","- UNEXPECTED\t:can be ignored when loading from different task/architecture; not ok if you expect identical arch.\n"]},{"output_type":"stream","name":"stdout","text":["{'pixel_values': tensor([[[[-1.5295, -1.5587, -1.4857,  ..., -1.4419, -1.3981, -1.5733],\n","          [-1.5879, -1.5441, -1.5149,  ..., -1.3835, -1.4565, -1.6609],\n","          [-1.5587, -1.5733, -1.5587,  ..., -1.3397, -1.4711, -1.5733],\n","          ...,\n","          [ 1.0982,  1.1420,  0.9376,  ...,  1.2734,  1.3610,  1.3172],\n","          [ 0.9814,  1.1128,  1.0836,  ...,  1.3026,  1.2880,  1.3318],\n","          [ 1.1420,  1.1274,  1.1566,  ...,  1.3610,  1.2150,  1.1712]],\n","\n","         [[-1.4669, -1.4669, -1.3919,  ..., -1.1368, -1.0467, -1.2118],\n","          [-1.5270, -1.4519, -1.4219,  ..., -1.1068, -1.1068, -1.3019],\n","          [-1.4970, -1.4970, -1.4669,  ..., -1.0617, -1.1668, -1.2268],\n","          ...,\n","          [ 0.8893,  0.9343,  0.7542,  ...,  1.5046,  1.5946,  1.5496],\n","          [ 0.7542,  0.9043,  0.9043,  ...,  1.5346,  1.5196,  1.5646],\n","          [ 0.9043,  0.9043,  0.9793,  ...,  1.5946,  1.4446,  1.3995]],\n","\n","         [[-1.2954, -1.3238, -1.2669,  ..., -0.9256, -0.8830, -1.0821],\n","          [-1.3522, -1.3096, -1.2954,  ..., -0.8545, -0.9256, -1.1247],\n","          [-1.3238, -1.3522, -1.3522,  ..., -0.7692, -0.9114, -1.0110],\n","          ...,\n","          [ 0.4537,  0.5106,  0.3684,  ...,  1.3780,  1.4491,  1.4065],\n","          [ 0.3542,  0.4964,  0.5106,  ...,  1.3922,  1.3638,  1.4065],\n","          [ 0.4964,  0.5106,  0.5817,  ...,  1.4491,  1.2927,  1.2500]]]]), 'input_ids': tensor([[49406,   320,  1125,   539,   320,  2368, 49407],\n","        [49406,   320,  1125,   539,   320,  1929, 49407],\n","        [49406,   320,  1125,   539,  1559, 49407, 49407]]), 'attention_mask': tensor([[1, 1, 1, 1, 1, 1, 1],\n","        [1, 1, 1, 1, 1, 1, 1],\n","        [1, 1, 1, 1, 1, 1, 0]])}\n","0\n","text_model\n","CLIPTextTransformer(\n","  (embeddings): CLIPTextEmbeddings(\n","    (token_embedding): Embedding(49408, 512)\n","    (position_embedding): Embedding(77, 512)\n","  )\n","  (encoder): CLIPEncoder(\n","    (layers): ModuleList(\n","      (0-11): 12 x CLIPEncoderLayer(\n","        (self_attn): CLIPAttention(\n","          (k_proj): Linear(in_features=512, out_features=512, bias=True)\n","          (v_proj): Linear(in_features=512, out_features=512, bias=True)\n","          (q_proj): Linear(in_features=512, out_features=512, bias=True)\n","          (out_proj): Linear(in_features=512, out_features=512, bias=True)\n","        )\n","        (layer_norm1): LayerNorm((512,), eps=1e-05, elementwise_affine=True)\n","        (mlp): CLIPMLP(\n","          (activation_fn): QuickGELUActivation()\n","          (fc1): Linear(in_features=512, out_features=2048, bias=True)\n","          (fc2): Linear(in_features=2048, out_features=512, bias=True)\n","        )\n","        (layer_norm2): LayerNorm((512,), eps=1e-05, elementwise_affine=True)\n","      )\n","    )\n","  )\n","  (final_layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)\n",")\n","1\n","vision_model\n","CLIPVisionTransformer(\n","  (embeddings): CLIPVisionEmbeddings(\n","    (patch_embedding): Conv2d(3, 768, kernel_size=(32, 32), stride=(32, 32), bias=False)\n","    (position_embedding): Embedding(50, 768)\n","  )\n","  (pre_layrnorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","  (encoder): CLIPEncoder(\n","    (layers): ModuleList(\n","      (0-11): 12 x CLIPEncoderLayer(\n","        (self_attn): CLIPAttention(\n","          (k_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (v_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (q_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (out_proj): Linear(in_features=768, out_features=768, bias=True)\n","        )\n","        (layer_norm1): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","        (mlp): CLIPMLP(\n","          (activation_fn): QuickGELUActivation()\n","          (fc1): Linear(in_features=768, out_features=3072, bias=True)\n","          (fc2): Linear(in_features=3072, out_features=768, bias=True)\n","        )\n","        (layer_norm2): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","      )\n","    )\n","  )\n","  (post_layernorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n",")\n","2\n","visual_projection\n","Linear(in_features=768, out_features=512, bias=False)\n","3\n","text_projection\n","Linear(in_features=512, out_features=512, bias=False)\n","Text labels: ['a photo of a cat', 'a photo of a dog', 'a photo of food']\n","Probabilities: tensor([[4.7459e-04, 9.1137e-04, 9.9861e-01]])\n"]}],"source":["from transformers import AutoProcessor, CLIPModel\n","\n","name = \"openai/clip-vit-base-patch32\"\n","processor = AutoProcessor.from_pretrained(name)\n","model = CLIPModel.from_pretrained(name)\n","\n","texts = [\"a photo of a cat\", \"a photo of a dog\", \"a photo of food\"]\n","inputs = processor(text=texts, images=image, return_tensors=\"pt\", padding=True)\n","\n","print(inputs)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)\n","\n","with torch.no_grad():\n","    outputs = model(**inputs)\n","\n","logits_per_image = outputs.logits_per_image\n","probs = logits_per_image.softmax(dim=1)\n","\n","print(\"Text labels:\", texts)\n","print(\"Probabilities:\", probs)\n"],"id":"Y5DHJjoe2CoM"},{"cell_type":"code","execution_count":13,"metadata":{"id":"0JoNggkF2CoM","colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["8d71233139a647fbaf1c6a914e17c0be","946f95df73434204b04c60d3211ecca7","716d39516a3048fa896318769d36baf6","6dde28241003443681696c11710e883f","83a48839e9c1419a80062ba8597a4eb1","f302a8a3af2a49d5ac20ed43455722ca","3ee14a46973243b89f5885a90b9bf1e0","b939df4f16654586b153cc0562673aa7","cef84ea6917d42698b31232ef019bfc3","34800cb682fd4fa3a6b6100225f1da01","694dbfa46cbf4aa4930d53915db7d1f2","ac212f87352a45baaa62a7d810e8d9ea","d95670fadbf5455985df00b854d9df41","861ea3420e774628b84c25b7d374759e","e53cc23e76804583b7c409fbb14a73a2","bd86aed1ab984d2c80888155415a6884","3bf098dc68d0496899653f91aa449840","71ec22ff0e5a44109c5e41b84316ffb5","5eb66efbd8d94e3d8fd2374b7b88d60f","ee877b42e35b4f248374e7acfb1d7148","67e2cce6e13741d6b98be054e135c648","4dc05e7f76d946dab7f798c1bbd48fde","2dbabe36a939453cab56c4dd30b504e3","6b70468278ae4466a13c4e7667971733","ca08eab466c44332a36da8f68db7b0f6","c1c1d839ef824c909e376ca1c6dbeebe","728e62f97cca4eabace68f8ed08dbd94","92b75b3b72594babbeff31a67dce1444","d426591c50364b8aaa5a17f8b0ccdaeb","49b3c06379fb44dd9c72da46050a143f","dcb25d0ce5a5410cb97463fa7d6479e8","bb511d3e83e34503b031c9c43db680f7","df0ee92d701241b6befcf122137a2571","02d59ad3f31c4cdaa5605fe480b1da26","1e6cc2e6fe1a4d99b743555618d6ffde","aa66086e8d574e8da1160c71e5d20438","d4fca5f002ae4a1ca53258c2e19a80b9","eaa93bee05b642ec957011892dc7b639","72f3d5ebcc8942e09917627568d6417c","4b2cbc6848e745a7a3b9c0e00c4f35fe","537db4eef7af4c6d93df80cdfce983ac","93018fd2848b4f90a3a546d597e64d30","9847149be2c04a2f877c6d4261539f96","ade1d992b8de4c33bf4cfdab796d9572","8024becd7d6c4bec8e5a1865e4663952","c15864cab49340c497004c070b6be8e7","b6ebf2f5dc2c4127ba16051e6a3c9c72","585b905863324370bd96e2148a6d4798","9e42359df9ce47f4a6bd331f1db4cf2e","a63e7df6fecb4f42bca00f5307fb4b47","cf98249bcaf7457fb8e7eb4770c096e0","90211e16ca4a4c498c4510b163c66597","54f438a761374a679d4f6aa521807d06","070bc2bc921849c3abd9b6f845cdc44e","d3161206e593409d932453830cff92e6","4eddec051ef84f9abadeb73ba9e25ce7","92cf4b3b18b44d3ba203c9aea171873f","0ba52f4643e147c48bd24c8ee0f9a916","383db5a6ee694c9c93c34e0d776444b2","5db45c18a2fd45fb942d2b539a79d373","a4ec67b0d4a2420eb4b2e2cbb2a74c57","8e2dc9f2d92542a4bcfaf8369dd07f99","3fd646190e184cdcb67e0481f1b144e6","2c79d80e138f47c18d202f1bd9924181","9a05b45f215544b3aafb80b63900f975","a8ad3b472287485c97821c224c8345b3","8c1b0428feda4892ad479a953aff1dfe","ee029469728143ffb309831068b0522e","bf34a099be6041969e0df49ea8f0a603","7ca5139b6c5b4bd998081398bb0e6173","cea1053a80c64ec7aac07db9cf0d9253","6a2d70b1ce544eb1bfc86b41283c35b7","6e26ebddd05640ff8c14cbd0b80d8b2c","8939c6f404ff49a3bdbe4c1485b51eb2","53cf831204fc4841840eeef3a78850b3","6671c778373d4a13961bb2d3cf4c1948","388e030beacd40e18e0fd352f7a849e9","89a9dd499cf040fea30ac91f856e14dd","22252790209f49b19d37455b66e9742b","ef2ae19f915e4575a78e7cf1f1cbb1fe","d74081b9024a4376b66da56aaefcf6c0","4a4023e64fbf4c98b7d56a32b5881ee0","31b4929e72f042f3a90ef62b86849b22","da03680be2c146eca4ccc8f954e54ee6","1a6e8cdd0ec043db902a3b173c48dee3","10693ab557c94a6d8d19a3f4ab92dbfc","21322cf548914be9a6b0d30ca56f3e3b","c87e16f42e8c4ab3b48f9163641f80bf","26849bd0c3ae4056bd589e7d79196022","547d4559a02a486a846d6031bed42d47","2d943cac6e4e409a986678a8e6b8139a","6e057034527546c09b1322ec9f939ed7","d0c1eeee9c124a9285a412a816940f7f","a1e9170dfe79499e976cedbee5283fc8","93296bf1853e45d79da67d637c601ac6","9dd999da10bc4da18476761b63659447","b64cab0f7920450b951946986ae71e33","fd423e63f0f14ece939305926bcbfdac","e0117d6c331b40ff9e1b717655ddd7df"]},"executionInfo":{"status":"ok","timestamp":1774139187720,"user_tz":240,"elapsed":21398,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"9fc93a94-bbd9-459c-855b-1452dd15bb2b"},"outputs":[{"output_type":"display_data","data":{"text/plain":["preprocessor_config.json:   0%|          | 0.00/316 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"8d71233139a647fbaf1c6a914e17c0be"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["tokenizer_config.json:   0%|          | 0.00/905 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"ac212f87352a45baaa62a7d810e8d9ea"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["config.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"2dbabe36a939453cab56c4dd30b504e3"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["vocab.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"02d59ad3f31c4cdaa5605fe480b1da26"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["merges.txt: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"8024becd7d6c4bec8e5a1865e4663952"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["tokenizer.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"4eddec051ef84f9abadeb73ba9e25ce7"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["special_tokens_map.json:   0%|          | 0.00/389 [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"8c1b0428feda4892ad479a953aff1dfe"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["model.safetensors:   0%|          | 0.00/1.71G [00:00<?, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"89a9dd499cf040fea30ac91f856e14dd"}},"metadata":{}},{"output_type":"display_data","data":{"text/plain":["Loading weights:   0%|          | 0/590 [00:00<?, ?it/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"26849bd0c3ae4056bd589e7d79196022"}},"metadata":{}},{"output_type":"stream","name":"stderr","text":["CLIPModel LOAD REPORT from: openai/clip-vit-large-patch14\n","Key                                  | Status     |  | \n","-------------------------------------+------------+--+-\n","text_model.embeddings.position_ids   | UNEXPECTED |  | \n","vision_model.embeddings.position_ids | UNEXPECTED |  | \n","\n","Notes:\n","- UNEXPECTED\t:can be ignored when loading from different task/architecture; not ok if you expect identical arch.\n"]},{"output_type":"stream","name":"stdout","text":["{'pixel_values': tensor([[[[-1.5295, -1.5587, -1.4857,  ..., -1.4419, -1.3981, -1.5733],\n","          [-1.5879, -1.5441, -1.5149,  ..., -1.3835, -1.4565, -1.6609],\n","          [-1.5587, -1.5733, -1.5587,  ..., -1.3397, -1.4711, -1.5733],\n","          ...,\n","          [ 1.0982,  1.1420,  0.9376,  ...,  1.2734,  1.3610,  1.3172],\n","          [ 0.9814,  1.1128,  1.0836,  ...,  1.3026,  1.2880,  1.3318],\n","          [ 1.1420,  1.1274,  1.1566,  ...,  1.3610,  1.2150,  1.1712]],\n","\n","         [[-1.4669, -1.4669, -1.3919,  ..., -1.1368, -1.0467, -1.2118],\n","          [-1.5270, -1.4519, -1.4219,  ..., -1.1068, -1.1068, -1.3019],\n","          [-1.4970, -1.4970, -1.4669,  ..., -1.0617, -1.1668, -1.2268],\n","          ...,\n","          [ 0.8893,  0.9343,  0.7542,  ...,  1.5046,  1.5946,  1.5496],\n","          [ 0.7542,  0.9043,  0.9043,  ...,  1.5346,  1.5196,  1.5646],\n","          [ 0.9043,  0.9043,  0.9793,  ...,  1.5946,  1.4446,  1.3995]],\n","\n","         [[-1.2954, -1.3238, -1.2669,  ..., -0.9256, -0.8830, -1.0821],\n","          [-1.3522, -1.3096, -1.2954,  ..., -0.8545, -0.9256, -1.1247],\n","          [-1.3238, -1.3522, -1.3522,  ..., -0.7692, -0.9114, -1.0110],\n","          ...,\n","          [ 0.4537,  0.5106,  0.3684,  ...,  1.3780,  1.4491,  1.4065],\n","          [ 0.3542,  0.4964,  0.5106,  ...,  1.3922,  1.3638,  1.4065],\n","          [ 0.4964,  0.5106,  0.5817,  ...,  1.4491,  1.2927,  1.2500]]]]), 'input_ids': tensor([[49406,   320,  1125,   539,  9753, 49407, 49407],\n","        [49406,   320,  1125,   539,   320,  1929, 49407],\n","        [49406,   320,  1125,   539,   320,  2307, 49407],\n","        [49406,   320,  1125,   539,  4023, 49407, 49407]]), 'attention_mask': tensor([[1, 1, 1, 1, 1, 1, 0],\n","        [1, 1, 1, 1, 1, 1, 1],\n","        [1, 1, 1, 1, 1, 1, 1],\n","        [1, 1, 1, 1, 1, 1, 0]])}\n","0\n","text_model\n","CLIPTextTransformer(\n","  (embeddings): CLIPTextEmbeddings(\n","    (token_embedding): Embedding(49408, 768)\n","    (position_embedding): Embedding(77, 768)\n","  )\n","  (encoder): CLIPEncoder(\n","    (layers): ModuleList(\n","      (0-11): 12 x CLIPEncoderLayer(\n","        (self_attn): CLIPAttention(\n","          (k_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (v_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (q_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (out_proj): Linear(in_features=768, out_features=768, bias=True)\n","        )\n","        (layer_norm1): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","        (mlp): CLIPMLP(\n","          (activation_fn): QuickGELUActivation()\n","          (fc1): Linear(in_features=768, out_features=3072, bias=True)\n","          (fc2): Linear(in_features=3072, out_features=768, bias=True)\n","        )\n","        (layer_norm2): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","      )\n","    )\n","  )\n","  (final_layer_norm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n",")\n","1\n","vision_model\n","CLIPVisionTransformer(\n","  (embeddings): CLIPVisionEmbeddings(\n","    (patch_embedding): Conv2d(3, 1024, kernel_size=(14, 14), stride=(14, 14), bias=False)\n","    (position_embedding): Embedding(257, 1024)\n","  )\n","  (pre_layrnorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)\n","  (encoder): CLIPEncoder(\n","    (layers): ModuleList(\n","      (0-23): 24 x CLIPEncoderLayer(\n","        (self_attn): CLIPAttention(\n","          (k_proj): Linear(in_features=1024, out_features=1024, bias=True)\n","          (v_proj): Linear(in_features=1024, out_features=1024, bias=True)\n","          (q_proj): Linear(in_features=1024, out_features=1024, bias=True)\n","          (out_proj): Linear(in_features=1024, out_features=1024, bias=True)\n","        )\n","        (layer_norm1): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)\n","        (mlp): CLIPMLP(\n","          (activation_fn): QuickGELUActivation()\n","          (fc1): Linear(in_features=1024, out_features=4096, bias=True)\n","          (fc2): Linear(in_features=4096, out_features=1024, bias=True)\n","        )\n","        (layer_norm2): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)\n","      )\n","    )\n","  )\n","  (post_layernorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True)\n",")\n","2\n","visual_projection\n","Linear(in_features=1024, out_features=768, bias=False)\n","3\n","text_projection\n","Linear(in_features=768, out_features=768, bias=False)\n","Best label: a photo of dessert\n","Probabilities: tensor([[9.8582e-01, 2.6894e-03, 6.2265e-04, 1.0865e-02]])\n"]}],"source":["# Zero-shot classification example with a larger CLIP model\n","\n","name = \"openai/clip-vit-large-patch14\"\n","processor = AutoProcessor.from_pretrained(name)\n","model = CLIPModel.from_pretrained(name)\n","\n","candidate_labels = [\n","    \"a photo of dessert\",\n","    \"a photo of a dog\",\n","    \"a photo of a building\",\n","    \"a photo of flowers\",\n","]\n","\n","inputs = processor(text=candidate_labels, images=image, return_tensors=\"pt\", padding=True)\n","\n","print(inputs)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)\n","\n","with torch.no_grad():\n","    outputs = model(**inputs)\n","\n","probs = outputs.logits_per_image.softmax(dim=1)\n","best_idx = probs.argmax(dim=1).item()\n","\n","print(\"Best label:\", candidate_labels[best_idx])\n","print(\"Probabilities:\", probs)\n"],"id":"0JoNggkF2CoM"},{"cell_type":"code","execution_count":14,"metadata":{"id":"GBQCshC82CoM","colab":{"base_uri":"https://localhost:8080/","height":1000,"referenced_widgets":["be434cd3424f4345ad9a1eee465bebff","3360574d9fe74d0aa452c746740c57f4","0d00e1a6dd024948bd281b9327d8c008","ee12bec5377649bc901100669e59343a","427f16d0b1d246438c2070c66472b9c2","33eedd5a06274a11b7b270d1560623ef","57ad3d3a573044519d981bf32957f715","ad0220be1b85436a8bbff7f65b107553","4e7032609150462cad3bdce6d44f8efe","8facbfaaa5fb44928301af44370ec4ea","e613b2bd211c4e6ea1bbb611904eb14b"]},"executionInfo":{"status":"ok","timestamp":1774139189915,"user_tz":240,"elapsed":2181,"user":{"displayName":"USA AI Olympiad","userId":"00527651721180390785"}},"outputId":"5c8819e2-7a3b-4b36-fa98-e3e42b3ce0b8"},"outputs":[{"output_type":"display_data","data":{"text/plain":["config.json: 0.00B [00:00, ?B/s]"],"application/vnd.jupyter.widget-view+json":{"version_major":2,"version_minor":0,"model_id":"be434cd3424f4345ad9a1eee465bebff"}},"metadata":{}},{"output_type":"stream","name":"stdout","text":["0\n","text_model\n","CLIPTextTransformer(\n","  (embeddings): CLIPTextEmbeddings(\n","    (token_embedding): Embedding(49408, 512)\n","    (position_embedding): Embedding(77, 512)\n","  )\n","  (encoder): CLIPEncoder(\n","    (layers): ModuleList(\n","      (0-11): 12 x CLIPEncoderLayer(\n","        (self_attn): CLIPAttention(\n","          (k_proj): Linear(in_features=512, out_features=512, bias=True)\n","          (v_proj): Linear(in_features=512, out_features=512, bias=True)\n","          (q_proj): Linear(in_features=512, out_features=512, bias=True)\n","          (out_proj): Linear(in_features=512, out_features=512, bias=True)\n","        )\n","        (layer_norm1): LayerNorm((512,), eps=1e-05, elementwise_affine=True)\n","        (mlp): CLIPMLP(\n","          (activation_fn): QuickGELUActivation()\n","          (fc1): Linear(in_features=512, out_features=2048, bias=True)\n","          (fc2): Linear(in_features=2048, out_features=512, bias=True)\n","        )\n","        (layer_norm2): LayerNorm((512,), eps=1e-05, elementwise_affine=True)\n","      )\n","    )\n","  )\n","  (final_layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)\n",")\n","1\n","vision_model\n","CLIPVisionTransformer(\n","  (embeddings): CLIPVisionEmbeddings(\n","    (patch_embedding): Conv2d(3, 768, kernel_size=(16, 16), stride=(16, 16), bias=False)\n","    (position_embedding): Embedding(197, 768)\n","  )\n","  (pre_layrnorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","  (encoder): CLIPEncoder(\n","    (layers): ModuleList(\n","      (0-11): 12 x CLIPEncoderLayer(\n","        (self_attn): CLIPAttention(\n","          (k_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (v_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (q_proj): Linear(in_features=768, out_features=768, bias=True)\n","          (out_proj): Linear(in_features=768, out_features=768, bias=True)\n","        )\n","        (layer_norm1): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","        (mlp): CLIPMLP(\n","          (activation_fn): QuickGELUActivation()\n","          (fc1): Linear(in_features=768, out_features=3072, bias=True)\n","          (fc2): Linear(in_features=3072, out_features=768, bias=True)\n","        )\n","        (layer_norm2): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n","      )\n","    )\n","  )\n","  (post_layernorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True)\n",")\n","2\n","visual_projection\n","Linear(in_features=768, out_features=512, bias=False)\n","3\n","text_projection\n","Linear(in_features=512, out_features=512, bias=False)\n"]}],"source":["# Randomly initialized CLIP example\n","\n","name = \"openai/clip-vit-base-patch16\"\n","config = AutoConfig.from_pretrained(name)\n","# For CLIP, AutoModel.from_config gives the architecture with random weights.\n","\n","model = AutoModel.from_config(config)\n","\n","for idx, (name, child) in enumerate(model.named_children()):\n","    print(idx)\n","    print(name)\n","    print(child)"],"id":"GBQCshC82CoM"},{"cell_type":"markdown","metadata":{"id":"8re6-T1T2CoM"},"source":["## 11. Practical advice for students\n","\n","### Use ViT / DeiT / BEiT / Swin when:\n","- Your input is only images\n","- You need image classification or visual features\n","- You are building a computer vision pipeline\n","\n","### Use CLIP when:\n","- You need image-text matching\n","- You want zero-shot image classification\n","- You want a multimodal model without separate supervised classifier training\n","\n","### Quick beginner suggestions\n","- Standard vision transformer: `google/vit-base-patch16-224`\n","- Better data-efficient ViT-style model: `facebook/deit-base-patch16-224`\n","- Most BERT-like vision pretraining idea: `microsoft/beit-base-patch16-224`\n","- Most vision-specific hierarchical backbone: `microsoft/swin-tiny-patch4-window7-224`\n","- Easiest CLIP starting point: `openai/clip-vit-base-patch32`\n","- Stronger CLIP variant: `openai/clip-vit-large-patch14`\n"],"id":"8re6-T1T2CoM"},{"cell_type":"markdown","metadata":{"id":"jRBq6aNl2CoM"},"source":["## 12. Summary comparison tables\n","\n","### NLP models\n","\n","| Model | Architecture | Best mental model |\n","|---|---|---|\n","| `bert-base-uncased` | Encoder-only | Classic BERT |\n","| `roberta-base` | Encoder-only | Better-trained BERT |\n","| `distilbert-base-uncased` | Encoder-only | Smaller/faster BERT |\n","| `albert-base-v2` | Encoder-only | Parameter-efficient BERT |\n","| `microsoft/deberta-base` | Encoder-only | More advanced BERT-family encoder |\n","| `gpt2` | Decoder-only | Classic small GPT-style model |\n","| `microsoft/Phi-3-mini-4k-instruct` | Decoder-only | Small instruction-tuned GPT-style chat model |\n","| `t5-small` | Encoder-decoder | Small T5 text-to-text model |\n","| `t5-base` | Encoder-decoder | Larger T5 text-to-text model |\n","| `google/mt5-base` | Encoder-decoder | Multilingual T5 |\n","| `facebook/bart-base` | Encoder-decoder | BERT-like encoder + GPT-like decoder |\n","\n","### Vision transformer models\n","\n","| Model | Architecture | Best mental model |\n","|---|---|---|\n","| `google/vit-base-patch16-224` | Vision transformer encoder | Standard ViT |\n","| `facebook/deit-base-patch16-224` | Vision transformer encoder | More data-efficient ViT |\n","| `microsoft/beit-base-patch16-224` | Vision transformer encoder | BERT-style image pretraining |\n","| `microsoft/swin-tiny-patch4-window7-224` | Hierarchical vision transformer | Windowed, multiscale vision transformer |\n","\n","### CLIP models\n","\n","| Model | Architecture | Best mental model |\n","|---|---|---|\n","| `openai/clip-vit-base-patch16` | Dual-encoder multimodal | CLIP with ViT-B/16 |\n","| `openai/clip-vit-base-patch32` | Dual-encoder multimodal | CLIP with ViT-B/32 |\n","| `openai/clip-vit-large-patch14` | Dual-encoder multimodal | Larger CLIP |\n","| `openai/clip-vit-large-patch14-336` | Dual-encoder multimodal | Larger CLIP with higher image resolution |\n"],"id":"jRBq6aNl2CoM"}],"metadata":{"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"name":"python","version":"3.11"},"colab":{"provenance":[]},"widgets":{"application/vnd.jupyter.widget-state+json":{"c6358dd4c5d44f7480b353cba749fc22":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_a3ecd2f5e94d499e9d6d0837ce4e8af9","IPY_MODEL_1bd557247aad48769825263d5c77d5fc","IPY_MODEL_febb37f9de7148dbb356e434c40c6553"],"layout":"IPY_MODEL_b5e32d0087494416b9c05b16c98d5a90"}},"a3ecd2f5e94d499e9d6d0837ce4e8af9":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_848e6a16f61a477ca394e361695263eb","placeholder":"​","style":"IPY_MODEL_7181faa8adca4651b4a4d30d0fd30ccd","value":"config.json: 100%"}},"1bd557247aad48769825263d5c77d5fc":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_443b56998c354e08a88e8087fe79681c","max":570,"min":0,"orientation":"horizontal","style":"IPY_MODEL_55a6dcabb24e411ca8753cd974b5f5c2","value":570}},"febb37f9de7148dbb356e434c40c6553":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_47076c924d2642f49b1b315123910b1b","placeholder":"​","style":"IPY_MODEL_c2253a479f4d46349797ae5c76ce5caa","value":" 570/570 [00:00&lt;00:00, 9.42kB/s]"}},"b5e32d0087494416b9c05b16c98d5a90":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"848e6a16f61a477ca394e361695263eb":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"7181faa8adca4651b4a4d30d0fd30ccd":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"443b56998c354e08a88e8087fe79681c":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"55a6dcabb24e411ca8753cd974b5f5c2":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"47076c924d2642f49b1b315123910b1b":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"c2253a479f4d46349797ae5c76ce5caa":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"60f983780c124b3d967a321478a1cde4":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_c2a39ac4b0924d95b593c89ef48004d1","IPY_MODEL_bbc5608d12804d08819f1967ac6f1571","IPY_MODEL_1f116e23fd014ba0a2f990dd0bb31279"],"layout":"IPY_MODEL_3990dd60b1174b9e943f2774fb0427d1"}},"c2a39ac4b0924d95b593c89ef48004d1":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_394c49de5e4a4b31807ac476639ffde9","placeholder":"​","style":"IPY_MODEL_668c5ad9863d468bbe5017bc9ba98e50","value":"tokenizer_config.json: 100%"}},"bbc5608d12804d08819f1967ac6f1571":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_4d3063ccca6f4aa59842ead9b375aff0","max":48,"min":0,"orientation":"horizontal","style":"IPY_MODEL_95d307ed819e4baab083e5bfd9297444","value":48}},"1f116e23fd014ba0a2f990dd0bb31279":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_02279f996d924fee9e56e13272e5de00","placeholder":"​","style":"IPY_MODEL_e5c824d331314f0aa2dc13bbe6c1605a","value":" 48.0/48.0 [00:00&lt;00:00, 568B/s]"}},"3990dd60b1174b9e943f2774fb0427d1":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"394c49de5e4a4b31807ac476639ffde9":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"668c5ad9863d468bbe5017bc9ba98e50":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"4d3063ccca6f4aa59842ead9b375aff0":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"95d307ed819e4baab083e5bfd9297444":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"02279f996d924fee9e56e13272e5de00":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e5c824d331314f0aa2dc13bbe6c1605a":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"eba38c0a650b487595b85916099c1ca3":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_2b7b39d017d8446b83f33d0f89a8a0ff","IPY_MODEL_4bd57bcad8eb4179ada26b6c221b2ced","IPY_MODEL_dd0ec690139d4a2f82a10735a9f69ced"],"layout":"IPY_MODEL_d1029d32c0aa4261995a6a435deb0da7"}},"2b7b39d017d8446b83f33d0f89a8a0ff":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_29699abcf1ff477ea99ef26c45bc07f2","placeholder":"​","style":"IPY_MODEL_2a68599aa7c74c9aa956cdb64ea470ad","value":"vocab.txt: "}},"4bd57bcad8eb4179ada26b6c221b2ced":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_f1162b0de8b44ba1a892712427f9ed55","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_5772fa9bec3a467bb45290d3f11ed113","value":1}},"dd0ec690139d4a2f82a10735a9f69ced":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_4b296844bace484997abb8d73f8042df","placeholder":"​","style":"IPY_MODEL_2531f23e11254362a3cec6fdb26b1eda","value":" 232k/? [00:00&lt;00:00, 2.03MB/s]"}},"d1029d32c0aa4261995a6a435deb0da7":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"29699abcf1ff477ea99ef26c45bc07f2":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2a68599aa7c74c9aa956cdb64ea470ad":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"f1162b0de8b44ba1a892712427f9ed55":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"5772fa9bec3a467bb45290d3f11ed113":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"4b296844bace484997abb8d73f8042df":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2531f23e11254362a3cec6fdb26b1eda":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"28e9ff173c92415ca5d9e2f5a572578e":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_9d3b2640ba364f68bb81de55eb9d4662","IPY_MODEL_9973d4827ffe4fb09cb0667967443bac","IPY_MODEL_bb0361c9cfa045d5866dcde97e588a1e"],"layout":"IPY_MODEL_88951c2dd4794674bead5a26314ae405"}},"9d3b2640ba364f68bb81de55eb9d4662":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_94a2bbcbb2724022be0ff43aca12f342","placeholder":"​","style":"IPY_MODEL_71fc032c0b3147509731800777fab28c","value":"tokenizer.json: "}},"9973d4827ffe4fb09cb0667967443bac":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_16ea55f9d9ff4174b330be7cd2cda64b","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_a7387c32397b45b988df9e88910ca211","value":1}},"bb0361c9cfa045d5866dcde97e588a1e":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_2407da2a2cfb4922ae2b35921a8fc65f","placeholder":"​","style":"IPY_MODEL_63312cd62b134d3f8f57057832b9e520","value":" 466k/? [00:00&lt;00:00, 2.88MB/s]"}},"88951c2dd4794674bead5a26314ae405":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"94a2bbcbb2724022be0ff43aca12f342":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"71fc032c0b3147509731800777fab28c":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"16ea55f9d9ff4174b330be7cd2cda64b":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"a7387c32397b45b988df9e88910ca211":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"2407da2a2cfb4922ae2b35921a8fc65f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"63312cd62b134d3f8f57057832b9e520":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"0df2f7d906364335874dc6f52f578c26":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_a4367092824f46149c02962fa5ac3f5d","IPY_MODEL_7d2897e9c35845e4acc6bf21581e587f","IPY_MODEL_36725359a21b43ab942c8a3d681fc0aa"],"layout":"IPY_MODEL_841497034735431eb59a948c6be284b7"}},"a4367092824f46149c02962fa5ac3f5d":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_8cd8d518f9fd4e3da6e4b0b7d7ae5ca7","placeholder":"​","style":"IPY_MODEL_f868a45df8914b9aad9d503fa430917d","value":"model.safetensors: 100%"}},"7d2897e9c35845e4acc6bf21581e587f":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_0d9f01d776cd4fb78e836b34fbdcf98f","max":440449768,"min":0,"orientation":"horizontal","style":"IPY_MODEL_2e7b37d958e148d4ac221e85a27f2b2e","value":440449768}},"36725359a21b43ab942c8a3d681fc0aa":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a2f2813a05cd46d8b8b147048ed64d3c","placeholder":"​","style":"IPY_MODEL_3fcb7bb960ee4ad29342d53a00a3f34f","value":" 440M/440M [00:12&lt;00:00, 79.4MB/s]"}},"841497034735431eb59a948c6be284b7":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"8cd8d518f9fd4e3da6e4b0b7d7ae5ca7":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f868a45df8914b9aad9d503fa430917d":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"0d9f01d776cd4fb78e836b34fbdcf98f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2e7b37d958e148d4ac221e85a27f2b2e":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"a2f2813a05cd46d8b8b147048ed64d3c":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"3fcb7bb960ee4ad29342d53a00a3f34f":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"ba91336474d64e63adb7aed2adeb5cdf":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_0a9d5debe31a48c787f56b4e9d55befd","IPY_MODEL_0168147350a04c95b17a8341a9d0c0fa","IPY_MODEL_bccfe0b2bb38492b8c8d81ed60d9b76f"],"layout":"IPY_MODEL_49203e33a77640488a0c1142e25f1ce4"}},"0a9d5debe31a48c787f56b4e9d55befd":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_f2cfeeb729344272a8f1480f2a4d3297","placeholder":"​","style":"IPY_MODEL_84520d9c16774b75955bbd5cd9209b74","value":"Loading weights: 100%"}},"0168147350a04c95b17a8341a9d0c0fa":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_a8a32cc6f5dc44ffaee3e366ff6c88a1","max":199,"min":0,"orientation":"horizontal","style":"IPY_MODEL_2596fd6f2d344c4ab0858b4a4e77f8e3","value":199}},"bccfe0b2bb38492b8c8d81ed60d9b76f":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_d7f4b6e85af940c7b6c71691d824475d","placeholder":"​","style":"IPY_MODEL_7017076445054509bf976f76e61cf4e8","value":" 199/199 [00:00&lt;00:00, 249.56it/s, Materializing param=pooler.dense.weight]"}},"49203e33a77640488a0c1142e25f1ce4":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f2cfeeb729344272a8f1480f2a4d3297":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"84520d9c16774b75955bbd5cd9209b74":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"a8a32cc6f5dc44ffaee3e366ff6c88a1":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2596fd6f2d344c4ab0858b4a4e77f8e3":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"d7f4b6e85af940c7b6c71691d824475d":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"7017076445054509bf976f76e61cf4e8":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"6299934079d942eaa20811dfa3c61c89":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_cd37634a1ef2471aa30bd30cd07e3996","IPY_MODEL_b7dd6275a75c48f387e3c939d78127b8","IPY_MODEL_5d59289c56fb498e9f72fb33d9acea63"],"layout":"IPY_MODEL_59ef85b391354e32bebab426e2dd1c4d"}},"cd37634a1ef2471aa30bd30cd07e3996":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_af4507319ae9429f9a8c4058ae42eb47","placeholder":"​","style":"IPY_MODEL_676d931cc24542a2a682ef18a3685924","value":"config.json: 100%"}},"b7dd6275a75c48f387e3c939d78127b8":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_9df148a161b348e5aa28ceaef47c0244","max":665,"min":0,"orientation":"horizontal","style":"IPY_MODEL_8a649f9160074ad5b250372fef7820a9","value":665}},"5d59289c56fb498e9f72fb33d9acea63":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_d983749d347140b6bb6394a9fbd6c1fa","placeholder":"​","style":"IPY_MODEL_ebd4eecdf2b34696938859b01f86f454","value":" 665/665 [00:00&lt;00:00, 13.0kB/s]"}},"59ef85b391354e32bebab426e2dd1c4d":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"af4507319ae9429f9a8c4058ae42eb47":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"676d931cc24542a2a682ef18a3685924":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"9df148a161b348e5aa28ceaef47c0244":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"8a649f9160074ad5b250372fef7820a9":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"d983749d347140b6bb6394a9fbd6c1fa":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"ebd4eecdf2b34696938859b01f86f454":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"356b2012708b4ae4bbbc76fe52f8b1d9":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_528ad86891ef4b40ad8c43c669aaa691","IPY_MODEL_2df56fa64b8e47e897a6c3f41f773fe4","IPY_MODEL_c3d5376c141a4faf99662bb63df68bd7"],"layout":"IPY_MODEL_9e0c79611b794db983e4e9481b3bf583"}},"528ad86891ef4b40ad8c43c669aaa691":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_34936e88f7804224b30cc61a391a4809","placeholder":"​","style":"IPY_MODEL_aee02a3c7269490ea8918f2b509834ef","value":"tokenizer_config.json: 100%"}},"2df56fa64b8e47e897a6c3f41f773fe4":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_4ef0170fa8934f1ba7265e4bd7983969","max":26,"min":0,"orientation":"horizontal","style":"IPY_MODEL_111219f675f5432da8ccf799f8d6b934","value":26}},"c3d5376c141a4faf99662bb63df68bd7":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_2ea9e8fb360846d5b2911f778a7bace4","placeholder":"​","style":"IPY_MODEL_c7263d783a3e4f90a177dd30b6a280d1","value":" 26.0/26.0 [00:00&lt;00:00, 606B/s]"}},"9e0c79611b794db983e4e9481b3bf583":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"34936e88f7804224b30cc61a391a4809":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"aee02a3c7269490ea8918f2b509834ef":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"4ef0170fa8934f1ba7265e4bd7983969":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"111219f675f5432da8ccf799f8d6b934":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"2ea9e8fb360846d5b2911f778a7bace4":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"c7263d783a3e4f90a177dd30b6a280d1":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"9d753817b6ce4a85b09ac75d63453cff":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_f4df1af1793544c5956d7eb5989b8481","IPY_MODEL_6b7325dcfec544e893901c98e22416e8","IPY_MODEL_176748cd3e78495cab22d9a43cc83a64"],"layout":"IPY_MODEL_4992f2e06fad4715b53361aef54332dc"}},"f4df1af1793544c5956d7eb5989b8481":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_4e3310c01bf347008990fdc2c7745aa0","placeholder":"​","style":"IPY_MODEL_e2184b13e3024c51977a58fb024582a9","value":"vocab.json: "}},"6b7325dcfec544e893901c98e22416e8":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_e356c19cc3804920a40771289f8b35ee","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_97c9e9932f7e4f09af726ba3a6763377","value":1}},"176748cd3e78495cab22d9a43cc83a64":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_8d3b03e29a894b7393364af5a450c8aa","placeholder":"​","style":"IPY_MODEL_7d4c589931e1457d9528b63bea33ca77","value":" 1.04M/? [00:00&lt;00:00, 12.0MB/s]"}},"4992f2e06fad4715b53361aef54332dc":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"4e3310c01bf347008990fdc2c7745aa0":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e2184b13e3024c51977a58fb024582a9":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"e356c19cc3804920a40771289f8b35ee":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"97c9e9932f7e4f09af726ba3a6763377":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"8d3b03e29a894b7393364af5a450c8aa":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"7d4c589931e1457d9528b63bea33ca77":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"8aeb9add6b2c4db49094f7f41758ff10":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_411e657edc0e454a831ba5a2e78c7903","IPY_MODEL_fc8ed2cbcf24438a99b79984c9050926","IPY_MODEL_df538915985b4dbcbc8f1384feea0d2f"],"layout":"IPY_MODEL_3a1e9402af0b43e48b2134c7d3bb783f"}},"411e657edc0e454a831ba5a2e78c7903":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_e0185d76e5094ecaa98fbc99ccf7f872","placeholder":"​","style":"IPY_MODEL_01899a62f50447b08e3fdf4729e0286d","value":"merges.txt: "}},"fc8ed2cbcf24438a99b79984c9050926":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_9e2ea2c6d04e41668e39c6aafb765df1","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_9f92571c47034bbaae8dcbc706ee215d","value":1}},"df538915985b4dbcbc8f1384feea0d2f":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_1c88e857e493494cb7a725001aa6f253","placeholder":"​","style":"IPY_MODEL_acf8d3b301a54a188e67d3c34beeb1d2","value":" 456k/? [00:00&lt;00:00, 5.22MB/s]"}},"3a1e9402af0b43e48b2134c7d3bb783f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e0185d76e5094ecaa98fbc99ccf7f872":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"01899a62f50447b08e3fdf4729e0286d":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"9e2ea2c6d04e41668e39c6aafb765df1":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"9f92571c47034bbaae8dcbc706ee215d":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"1c88e857e493494cb7a725001aa6f253":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"acf8d3b301a54a188e67d3c34beeb1d2":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"dd5e6bfd9bad4d4084f9495dffa79459":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_9b3e41d5dfc2450694165875086f4a32","IPY_MODEL_061aecaa63e74abdbd274c4e81aa99ec","IPY_MODEL_e4ff9f1f2e094b93935d8bb9f11cdba2"],"layout":"IPY_MODEL_d9f79688a31f450aab224fa3fab0ec29"}},"9b3e41d5dfc2450694165875086f4a32":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_1cf20e594364472a8e22f21745e7e957","placeholder":"​","style":"IPY_MODEL_e6625114507243ebbfadd2376da5d6eb","value":"tokenizer.json: "}},"061aecaa63e74abdbd274c4e81aa99ec":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_6158cdace7b5415a925b29f017f94618","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_011ddd9cf4ef4029aa0048da67c638d8","value":1}},"e4ff9f1f2e094b93935d8bb9f11cdba2":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_5c2a84c9b21743eb9a072b41772f8d76","placeholder":"​","style":"IPY_MODEL_2ded1b82cef14066ab008d61e3de304a","value":" 1.36M/? [00:00&lt;00:00, 8.65MB/s]"}},"d9f79688a31f450aab224fa3fab0ec29":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1cf20e594364472a8e22f21745e7e957":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e6625114507243ebbfadd2376da5d6eb":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"6158cdace7b5415a925b29f017f94618":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"011ddd9cf4ef4029aa0048da67c638d8":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"5c2a84c9b21743eb9a072b41772f8d76":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2ded1b82cef14066ab008d61e3de304a":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"2d43b3d2bbf9443186f6cbb220943f1b":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_f95e59464ed941f69382ad22041dee00","IPY_MODEL_d8aa647c2c314cceaf3251ae5e265f98","IPY_MODEL_4a1e4f8015e74d9e97ed3b710c5d748f"],"layout":"IPY_MODEL_4f1077c605e546db8b3abf735c6691bc"}},"f95e59464ed941f69382ad22041dee00":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_cd50f2e1149e4fc683ede7bfa5b2a05a","placeholder":"​","style":"IPY_MODEL_3d38ae0f8ebd4079a6fd692f6a22fe1b","value":"model.safetensors: 100%"}},"d8aa647c2c314cceaf3251ae5e265f98":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_b119d31901b946a1b7a4d9e45d93592b","max":548105171,"min":0,"orientation":"horizontal","style":"IPY_MODEL_70ebdcc0bd154b9592fe925ac80fb05b","value":548105171}},"4a1e4f8015e74d9e97ed3b710c5d748f":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_6087a132a11644b2800970a784602c27","placeholder":"​","style":"IPY_MODEL_e2d0f9b6f3ea4bf2961836e7962c644d","value":" 548M/548M [00:06&lt;00:00, 88.0MB/s]"}},"4f1077c605e546db8b3abf735c6691bc":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"cd50f2e1149e4fc683ede7bfa5b2a05a":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"3d38ae0f8ebd4079a6fd692f6a22fe1b":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"b119d31901b946a1b7a4d9e45d93592b":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"70ebdcc0bd154b9592fe925ac80fb05b":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"6087a132a11644b2800970a784602c27":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e2d0f9b6f3ea4bf2961836e7962c644d":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"e71d4e0b3a954c32abbee2d5750c9e21":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_b6ef08532dd74fc38e50366887340346","IPY_MODEL_fe346f25df6444018cf083b8f5431e33","IPY_MODEL_0bcb77bacb814dd495eca8f7b7ed9cf9"],"layout":"IPY_MODEL_2e610f31ff3549fcb76a91314db72032"}},"b6ef08532dd74fc38e50366887340346":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_7aecc01c736f46caa9b52f399622cf32","placeholder":"​","style":"IPY_MODEL_143bc5d02f1542b2978ce1507c0a6ad3","value":"Loading weights: 100%"}},"fe346f25df6444018cf083b8f5431e33":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_b76e2e9a7294454baffa344128b6ed94","max":148,"min":0,"orientation":"horizontal","style":"IPY_MODEL_5998b4fcf910454c8ea1b90678611ed0","value":148}},"0bcb77bacb814dd495eca8f7b7ed9cf9":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_99d87dbcb8ad42be972c5201cca79643","placeholder":"​","style":"IPY_MODEL_f4885475b76644bea20a86c9887b2377","value":" 148/148 [00:00&lt;00:00, 252.38it/s, Materializing param=transformer.wte.weight]"}},"2e610f31ff3549fcb76a91314db72032":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"7aecc01c736f46caa9b52f399622cf32":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"143bc5d02f1542b2978ce1507c0a6ad3":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"b76e2e9a7294454baffa344128b6ed94":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"5998b4fcf910454c8ea1b90678611ed0":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"99d87dbcb8ad42be972c5201cca79643":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f4885475b76644bea20a86c9887b2377":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"7b7c16edea314fd58b85b78c5c5efae8":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_b18b1888ab574c67adf2551ed49652b9","IPY_MODEL_310d0cdc30ba4869b7183d42bc7e3762","IPY_MODEL_44e6354b8a4f4c8d8c66f3c6d491a91b"],"layout":"IPY_MODEL_a12de6f1c1264296950d7155dea20703"}},"b18b1888ab574c67adf2551ed49652b9":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_b770d3dd96bb4cfcbfb303e0af718b1a","placeholder":"​","style":"IPY_MODEL_fb07092f359a4954845e97e51097e212","value":"generation_config.json: 100%"}},"310d0cdc30ba4869b7183d42bc7e3762":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_21a6936336ac4d0ca9000638cd4d530f","max":124,"min":0,"orientation":"horizontal","style":"IPY_MODEL_55faccd14f1543b1985ac823c7a8a0af","value":124}},"44e6354b8a4f4c8d8c66f3c6d491a91b":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_39ed2622f26c4405a2d7957559a23020","placeholder":"​","style":"IPY_MODEL_daca91326dfa4b06b62f2c2cf913e4a3","value":" 124/124 [00:00&lt;00:00, 2.43kB/s]"}},"a12de6f1c1264296950d7155dea20703":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"b770d3dd96bb4cfcbfb303e0af718b1a":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"fb07092f359a4954845e97e51097e212":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"21a6936336ac4d0ca9000638cd4d530f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"55faccd14f1543b1985ac823c7a8a0af":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"39ed2622f26c4405a2d7957559a23020":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"daca91326dfa4b06b62f2c2cf913e4a3":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"c41f8f9a039d4f1ab890aa0ab7e180c6":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_059e4cf965e8440a8a19e776e7ed57fe","IPY_MODEL_a601fc0e1b2d4ec2a2ddd8a187457c78","IPY_MODEL_5e9048178cbc45279a05505ebc767c9a"],"layout":"IPY_MODEL_82595082bea342fd870f7d4f0549ace9"}},"059e4cf965e8440a8a19e776e7ed57fe":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_f6682790f226496899816e59fe26d3c0","placeholder":"​","style":"IPY_MODEL_1402225553a04836abab4871797af3c7","value":"config.json: "}},"a601fc0e1b2d4ec2a2ddd8a187457c78":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_501c63d88580482982c5b2a19abce971","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_c32cd60437f74115a63850ecc72d6074","value":1}},"5e9048178cbc45279a05505ebc767c9a":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_12c5437fa06949b699ded88190a05538","placeholder":"​","style":"IPY_MODEL_4e557f93b791443392f6612121d92ee4","value":" 1.21k/? [00:00&lt;00:00, 22.2kB/s]"}},"82595082bea342fd870f7d4f0549ace9":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f6682790f226496899816e59fe26d3c0":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1402225553a04836abab4871797af3c7":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"501c63d88580482982c5b2a19abce971":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"c32cd60437f74115a63850ecc72d6074":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"12c5437fa06949b699ded88190a05538":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"4e557f93b791443392f6612121d92ee4":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"6937760b7d7c45c5bc2d60f51bc4a4c1":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_0b9e33ba7bc24b9c8d00c76fd2fc84c8","IPY_MODEL_db4a0671308f431180cf45dacfc49795","IPY_MODEL_a79186a3f1f042bf843f8dcf91784356"],"layout":"IPY_MODEL_be29a063c8414d16b0bb52d487623367"}},"0b9e33ba7bc24b9c8d00c76fd2fc84c8":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_e5e6de05f66445f585d049338782e9ef","placeholder":"​","style":"IPY_MODEL_adfa293df63141f1aa890f3f930bcd72","value":"tokenizer_config.json: "}},"db4a0671308f431180cf45dacfc49795":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_e207946947f049178234e439c1cec032","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_b630d81cfc6e44878240db7dcde76949","value":1}},"a79186a3f1f042bf843f8dcf91784356":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_109463faac47442ba1d5e99055b37ffa","placeholder":"​","style":"IPY_MODEL_44164cbff799474eb56ac543f41b6dbb","value":" 2.32k/? [00:00&lt;00:00, 54.4kB/s]"}},"be29a063c8414d16b0bb52d487623367":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e5e6de05f66445f585d049338782e9ef":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"adfa293df63141f1aa890f3f930bcd72":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"e207946947f049178234e439c1cec032":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"b630d81cfc6e44878240db7dcde76949":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"109463faac47442ba1d5e99055b37ffa":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"44164cbff799474eb56ac543f41b6dbb":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"a28e57c5d3ae429bb937b7e4beb669c3":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_40d4ecdd7bb84b87894ffe1266e6e9f8","IPY_MODEL_51c1a3e866eb45e197d3c592131ddef6","IPY_MODEL_f0167c1dfb6e4e1b84bbe5d11319684e"],"layout":"IPY_MODEL_7c5cf5b8fbea405c8ff9d5d500520c9a"}},"40d4ecdd7bb84b87894ffe1266e6e9f8":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_44816ad96fd94f01bf4304808579a75d","placeholder":"​","style":"IPY_MODEL_bb8d1ecb200f4610acb196b567708d71","value":"spiece.model: 100%"}},"51c1a3e866eb45e197d3c592131ddef6":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_7f81c42c2473493e899768e542bc3d43","max":791656,"min":0,"orientation":"horizontal","style":"IPY_MODEL_154836ab1f614e969750976f81c1f26b","value":791656}},"f0167c1dfb6e4e1b84bbe5d11319684e":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_c3130fb3b9454a4b836fb91c41ca44fa","placeholder":"​","style":"IPY_MODEL_8b5ca33d93e1410f9c096c0bf8b3531e","value":" 792k/792k [00:00&lt;00:00, 6.32MB/s]"}},"7c5cf5b8fbea405c8ff9d5d500520c9a":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"44816ad96fd94f01bf4304808579a75d":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"bb8d1ecb200f4610acb196b567708d71":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"7f81c42c2473493e899768e542bc3d43":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"154836ab1f614e969750976f81c1f26b":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"c3130fb3b9454a4b836fb91c41ca44fa":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"8b5ca33d93e1410f9c096c0bf8b3531e":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"4ec2c47f375d42319ed9fe1519a9c26b":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_93ab1cee13f44d1dbb4659b20204c1d3","IPY_MODEL_ba75fb8c03cc4e3bbfe81929c185edb6","IPY_MODEL_ec56746ecd2a49fcbae75168c323bfdc"],"layout":"IPY_MODEL_1cd08453cf2541da8823c9c2c096a7fe"}},"93ab1cee13f44d1dbb4659b20204c1d3":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_fcd7118005314dc48665edc8e0f6b55c","placeholder":"​","style":"IPY_MODEL_fa7772f3e0914968974b4f6f47300ffc","value":"tokenizer.json: "}},"ba75fb8c03cc4e3bbfe81929c185edb6":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_9264e7267f90487592086e278869ab73","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_092f8d02d1804e7b8e04ebec63201710","value":1}},"ec56746ecd2a49fcbae75168c323bfdc":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_d44699ce75c24b71ac5e56afb396226e","placeholder":"​","style":"IPY_MODEL_071b85921ab64142b1aea082321d1b4d","value":" 1.39M/? [00:00&lt;00:00, 17.0MB/s]"}},"1cd08453cf2541da8823c9c2c096a7fe":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"fcd7118005314dc48665edc8e0f6b55c":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"fa7772f3e0914968974b4f6f47300ffc":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"9264e7267f90487592086e278869ab73":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"092f8d02d1804e7b8e04ebec63201710":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"d44699ce75c24b71ac5e56afb396226e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"071b85921ab64142b1aea082321d1b4d":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"eefc4bd8560c405d9f1783cb3e48a8d9":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_f32f193fe7a849dd8e36ed65f5210296","IPY_MODEL_10d4eca65cdd4fd9badaa9cd2dd1f2ce","IPY_MODEL_4aa1ed9db65c458f877488d369c31f2e"],"layout":"IPY_MODEL_cff899ba63574e26870066732055c55a"}},"f32f193fe7a849dd8e36ed65f5210296":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_f8e1dc3faa684bc199056e56940b3bd1","placeholder":"​","style":"IPY_MODEL_de4886b66efc48c18f2b9c53ad26eac0","value":"model.safetensors: 100%"}},"10d4eca65cdd4fd9badaa9cd2dd1f2ce":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_318ef76bc37d4d0d8c209edf37864989","max":242043056,"min":0,"orientation":"horizontal","style":"IPY_MODEL_4db249a6578e42d19e5b239154aecbbb","value":242043056}},"4aa1ed9db65c458f877488d369c31f2e":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_139dd9aeedb04df9b2c027f6fc6b9759","placeholder":"​","style":"IPY_MODEL_045f283538584f64bd6c4db5fd317e7d","value":" 242M/242M [00:02&lt;00:00, 170MB/s]"}},"cff899ba63574e26870066732055c55a":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f8e1dc3faa684bc199056e56940b3bd1":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"de4886b66efc48c18f2b9c53ad26eac0":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"318ef76bc37d4d0d8c209edf37864989":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"4db249a6578e42d19e5b239154aecbbb":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"139dd9aeedb04df9b2c027f6fc6b9759":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"045f283538584f64bd6c4db5fd317e7d":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"2c5cd1ead70e4741831906ca0c7b4ae0":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_4f56221897614ab99a609c12f4d6b70a","IPY_MODEL_2de8ab3b214146028ffc504b2883e108","IPY_MODEL_e426037efd8841cabda80ea26221912e"],"layout":"IPY_MODEL_d526793fc3614005af27f5552620affb"}},"4f56221897614ab99a609c12f4d6b70a":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_9147ad1488a2420bb39f5ad51a2ed724","placeholder":"​","style":"IPY_MODEL_3986a20ae1504abeb430af7e3d8c869b","value":"Loading weights: 100%"}},"2de8ab3b214146028ffc504b2883e108":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_db5a771e145240c686cb9c657cd56df2","max":131,"min":0,"orientation":"horizontal","style":"IPY_MODEL_aa48f47b2e814b0a87a57c78ee566367","value":131}},"e426037efd8841cabda80ea26221912e":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_cc5f9cd2496d46b58c36cf252c958941","placeholder":"​","style":"IPY_MODEL_42422513cd79488d871d857dc28851f7","value":" 131/131 [00:00&lt;00:00, 188.14it/s, Materializing param=shared.weight]"}},"d526793fc3614005af27f5552620affb":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"9147ad1488a2420bb39f5ad51a2ed724":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"3986a20ae1504abeb430af7e3d8c869b":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"db5a771e145240c686cb9c657cd56df2":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"aa48f47b2e814b0a87a57c78ee566367":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"cc5f9cd2496d46b58c36cf252c958941":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"42422513cd79488d871d857dc28851f7":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"e2a8037ccc9c45318362c5fa4f2e7aed":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_2146cfb1a2ab4950ba3d981782eb3f73","IPY_MODEL_25325f2c98e34b6aa5ca23e3c56d1c85","IPY_MODEL_a61b55ce8d0d411abde2398f2e0c2363"],"layout":"IPY_MODEL_555fcf6288be4a2fb262861c2028a896"}},"2146cfb1a2ab4950ba3d981782eb3f73":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_9c2474006b774e3ea258283fed7fc916","placeholder":"​","style":"IPY_MODEL_34687e615cec4fe699ba4cc8482fd79e","value":"generation_config.json: 100%"}},"25325f2c98e34b6aa5ca23e3c56d1c85":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_6fa1c39c265741e2b4e57cdc3eadeba8","max":147,"min":0,"orientation":"horizontal","style":"IPY_MODEL_f6bbf1202de54d81b37ee4b48d709664","value":147}},"a61b55ce8d0d411abde2398f2e0c2363":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a1544fa5935a4d54aa0b207493467a82","placeholder":"​","style":"IPY_MODEL_0774bd4debb24f6c9ee0391a68dd7e9f","value":" 147/147 [00:00&lt;00:00, 2.02kB/s]"}},"555fcf6288be4a2fb262861c2028a896":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"9c2474006b774e3ea258283fed7fc916":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"34687e615cec4fe699ba4cc8482fd79e":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"6fa1c39c265741e2b4e57cdc3eadeba8":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f6bbf1202de54d81b37ee4b48d709664":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"a1544fa5935a4d54aa0b207493467a82":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"0774bd4debb24f6c9ee0391a68dd7e9f":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"ed33abe395db458d8df7a61483b24448":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_1687a396e37846309173787ad32cf5c4","IPY_MODEL_6e8fe3115d814503be3d75e06c91ce97","IPY_MODEL_32a2c4b2535d41669bb4b1db1e8619ae"],"layout":"IPY_MODEL_3aa4588e9e9844d9ba89848c7328e711"}},"1687a396e37846309173787ad32cf5c4":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_6c70c26493fe4e758719b75f2f816660","placeholder":"​","style":"IPY_MODEL_f36b13cac7e54ea888cbe6e5fa141e1d","value":"config.json: "}},"6e8fe3115d814503be3d75e06c91ce97":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_96e8e132d1914fafab238e25cf142e15","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_2d045a136a58469f90ccbb8a27204261","value":1}},"32a2c4b2535d41669bb4b1db1e8619ae":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_7e51b92113cd4b1dbff5df2c866176a8","placeholder":"​","style":"IPY_MODEL_d8fa10097bd544229314f400d551a322","value":" 1.72k/? [00:00&lt;00:00, 39.8kB/s]"}},"3aa4588e9e9844d9ba89848c7328e711":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"6c70c26493fe4e758719b75f2f816660":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f36b13cac7e54ea888cbe6e5fa141e1d":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"96e8e132d1914fafab238e25cf142e15":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"2d045a136a58469f90ccbb8a27204261":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"7e51b92113cd4b1dbff5df2c866176a8":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"d8fa10097bd544229314f400d551a322":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"88435def0598456dbe6a358cf28ededc":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_d80556eb321b4ed5bbfce46617826bcf","IPY_MODEL_d5df0856579a411394bbd9e252539b67","IPY_MODEL_74b061926d394dff8b6640f7b5eab29b"],"layout":"IPY_MODEL_13d0e05d22ca4e8da4b3f9c90b29c45e"}},"d80556eb321b4ed5bbfce46617826bcf":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_6b8cf97848344a1d80a66155926d38df","placeholder":"​","style":"IPY_MODEL_f79baf807e774d3b9154d535640d4584","value":"preprocessor_config.json: 100%"}},"d5df0856579a411394bbd9e252539b67":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_ae3c907b4230488c8ecd95a4aeb31eba","max":160,"min":0,"orientation":"horizontal","style":"IPY_MODEL_f40cc1cba2884cd4bd64f12bc980e305","value":160}},"74b061926d394dff8b6640f7b5eab29b":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_3d73d12220f84e1abdf39e836223c407","placeholder":"​","style":"IPY_MODEL_3ebfa4a3580840ba849b96a34c21e3d3","value":" 160/160 [00:00&lt;00:00, 12.3kB/s]"}},"13d0e05d22ca4e8da4b3f9c90b29c45e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"6b8cf97848344a1d80a66155926d38df":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f79baf807e774d3b9154d535640d4584":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"ae3c907b4230488c8ecd95a4aeb31eba":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f40cc1cba2884cd4bd64f12bc980e305":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"3d73d12220f84e1abdf39e836223c407":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"3ebfa4a3580840ba849b96a34c21e3d3":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"32e1e5a19bdb47e59c89bb5998d1e9de":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_443c5650ddbc4a13aa4c2dc791d7e29e","IPY_MODEL_fdebd904cd3940c5ac3c00665983f839","IPY_MODEL_4881ebc517fa4cebb319720945579bbd"],"layout":"IPY_MODEL_3980560b2d14416b813f61392112df09"}},"443c5650ddbc4a13aa4c2dc791d7e29e":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_1b6c8fe6803e466ca694c9fa043dce09","placeholder":"​","style":"IPY_MODEL_aaa5438661094c70bfd5c32a45b06be4","value":"config.json: "}},"fdebd904cd3940c5ac3c00665983f839":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_767a1fd370904406a3c757ea72d19a80","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_6893c5de9b5144b290e2ff6d9e746e7f","value":1}},"4881ebc517fa4cebb319720945579bbd":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_c2373e8ac37b4ba7875915b6f8cad031","placeholder":"​","style":"IPY_MODEL_926698f798114395be0ceee65dcaffe6","value":" 69.7k/? [00:00&lt;00:00, 4.19MB/s]"}},"3980560b2d14416b813f61392112df09":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1b6c8fe6803e466ca694c9fa043dce09":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"aaa5438661094c70bfd5c32a45b06be4":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"767a1fd370904406a3c757ea72d19a80":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"6893c5de9b5144b290e2ff6d9e746e7f":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"c2373e8ac37b4ba7875915b6f8cad031":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"926698f798114395be0ceee65dcaffe6":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"a459149af0b449d19d66922ef3ca8b10":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_99a77a1f5aa74605bac1274eba1f9508","IPY_MODEL_0fd3413a5c7043f7bd231ccb5696e5e2","IPY_MODEL_0b70242846bf4c44bb820d2c75e48b64"],"layout":"IPY_MODEL_7529a7f2c7744e38b249064171da16a2"}},"99a77a1f5aa74605bac1274eba1f9508":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_9771f00ede8e4ef08635273185563335","placeholder":"​","style":"IPY_MODEL_6a9eeeffefc3487584aeda9a271ead14","value":"model.safetensors: 100%"}},"0fd3413a5c7043f7bd231ccb5696e5e2":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_6fb6031a578849209587c057807b2d6f","max":346293852,"min":0,"orientation":"horizontal","style":"IPY_MODEL_28055acc6425410ea5ff979f5d3ba976","value":346293852}},"0b70242846bf4c44bb820d2c75e48b64":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_3aaa557628a9489581891f4d374976fd","placeholder":"​","style":"IPY_MODEL_3cde29c06a224550bc3f948d858c3088","value":" 346M/346M [00:02&lt;00:00, 228MB/s]"}},"7529a7f2c7744e38b249064171da16a2":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"9771f00ede8e4ef08635273185563335":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"6a9eeeffefc3487584aeda9a271ead14":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"6fb6031a578849209587c057807b2d6f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"28055acc6425410ea5ff979f5d3ba976":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"3aaa557628a9489581891f4d374976fd":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"3cde29c06a224550bc3f948d858c3088":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"0bf42ad077314e75856258986703d7d9":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_79ae523437c64955981beef0db48dea8","IPY_MODEL_9374c28068c74426b0ddf98e18196e9a","IPY_MODEL_67e524cb31444c57832f5d93a77181e8"],"layout":"IPY_MODEL_8018406d6ffe4e839a86b404a63a5730"}},"79ae523437c64955981beef0db48dea8":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_b06f07af94944ba49f4f49f4e5e9e5c3","placeholder":"​","style":"IPY_MODEL_09626506044543ce91af99f8a174ce2c","value":"Loading weights: 100%"}},"9374c28068c74426b0ddf98e18196e9a":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_5ef8a18f30ab4275a00afe720d418a9a","max":198,"min":0,"orientation":"horizontal","style":"IPY_MODEL_ecde06457f92492ab6394171fb003b8e","value":198}},"67e524cb31444c57832f5d93a77181e8":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_0b625dc49baf447d9f16da326128704e","placeholder":"​","style":"IPY_MODEL_e89978d6affa4dcdab6b31c7716b91fb","value":" 198/198 [00:00&lt;00:00, 550.78it/s, Materializing param=layernorm.weight]"}},"8018406d6ffe4e839a86b404a63a5730":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"b06f07af94944ba49f4f49f4e5e9e5c3":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"09626506044543ce91af99f8a174ce2c":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"5ef8a18f30ab4275a00afe720d418a9a":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"ecde06457f92492ab6394171fb003b8e":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"0b625dc49baf447d9f16da326128704e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e89978d6affa4dcdab6b31c7716b91fb":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"975b22a97c184b58a3ba4359262b09a8":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_525146832e294969b8bdc703bfddf883","IPY_MODEL_25677a00898c41d88243eedf8dbe8c3e","IPY_MODEL_f625138870cd40f0b1cadb63daa32636"],"layout":"IPY_MODEL_621cc4a079fe4f10b85ab05f1765561f"}},"525146832e294969b8bdc703bfddf883":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_7da5c91c8ebd41e7a35230e7271b3a92","placeholder":"​","style":"IPY_MODEL_a2e6ef3e6b6a4b0bba72c87be0181ba2","value":"preprocessor_config.json: 100%"}},"25677a00898c41d88243eedf8dbe8c3e":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_b8234ca7f55347009b8ea4240377d91e","max":160,"min":0,"orientation":"horizontal","style":"IPY_MODEL_721cf8f059d14fba92ed78ba9757841c","value":160}},"f625138870cd40f0b1cadb63daa32636":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_976eb7d033f648c5a4a1235dd00a6aea","placeholder":"​","style":"IPY_MODEL_6424d5d3dac847e4b4c8783416c2628a","value":" 160/160 [00:00&lt;00:00, 12.4kB/s]"}},"621cc4a079fe4f10b85ab05f1765561f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"7da5c91c8ebd41e7a35230e7271b3a92":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a2e6ef3e6b6a4b0bba72c87be0181ba2":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"b8234ca7f55347009b8ea4240377d91e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"721cf8f059d14fba92ed78ba9757841c":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"976eb7d033f648c5a4a1235dd00a6aea":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"6424d5d3dac847e4b4c8783416c2628a":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"78930ddac6804ee384a4d23a88bb6494":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_cd9e62c3b44641878a4858433a25fe31","IPY_MODEL_5f495b8f83874677bf7b642bb609561d","IPY_MODEL_aa269ff988ef4c4bbbe514350fbd793f"],"layout":"IPY_MODEL_c806158f6c4d4a7db8aed6b8dfc1904c"}},"cd9e62c3b44641878a4858433a25fe31":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_20d6ed2c4bf741c39ca3b3ad979fcfb9","placeholder":"​","style":"IPY_MODEL_d958f99b43054ed6b2f17849182a874e","value":"config.json: "}},"5f495b8f83874677bf7b642bb609561d":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_9e0a58ad3b324c678d98bb886b858dde","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_75e154e76dac405faec5ff4b4c3c5a75","value":1}},"aa269ff988ef4c4bbbe514350fbd793f":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_5650e6d8b6814fd5b6b418a3a2ec296f","placeholder":"​","style":"IPY_MODEL_71b54d935c6a4037a10378b0f62726d9","value":" 69.6k/? [00:00&lt;00:00, 4.57MB/s]"}},"c806158f6c4d4a7db8aed6b8dfc1904c":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"20d6ed2c4bf741c39ca3b3ad979fcfb9":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"d958f99b43054ed6b2f17849182a874e":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"9e0a58ad3b324c678d98bb886b858dde":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"75e154e76dac405faec5ff4b4c3c5a75":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"5650e6d8b6814fd5b6b418a3a2ec296f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"71b54d935c6a4037a10378b0f62726d9":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"e997f842b2c0400f870dac3a72ba959c":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_5de95ee692a14b6bb881b41932b291b3","IPY_MODEL_5bcec994291a4f75b178a798a0358833","IPY_MODEL_4d3a2a716a954a98aa03d94a59291f19"],"layout":"IPY_MODEL_11f54c2d605140058b85fb17fbc62308"}},"5de95ee692a14b6bb881b41932b291b3":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_90c3e5d4ba54402cbd70ce89164dc0d4","placeholder":"​","style":"IPY_MODEL_2940f038479d4bdcacbf19d548ece814","value":"pytorch_model.bin: 100%"}},"5bcec994291a4f75b178a798a0358833":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_d7c9b5955d35408f83dfd97d75b6be6e","max":346351599,"min":0,"orientation":"horizontal","style":"IPY_MODEL_724b00668d884c5b9870f8aaeabfa993","value":346351599}},"4d3a2a716a954a98aa03d94a59291f19":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_7aaf8b4ede874df6a5d9483eff9903c3","placeholder":"​","style":"IPY_MODEL_bc0ba910691b4b19a4a28260bda1bb5b","value":" 346M/346M [00:02&lt;00:00, 260MB/s]"}},"11f54c2d605140058b85fb17fbc62308":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"90c3e5d4ba54402cbd70ce89164dc0d4":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2940f038479d4bdcacbf19d548ece814":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"d7c9b5955d35408f83dfd97d75b6be6e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"724b00668d884c5b9870f8aaeabfa993":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"7aaf8b4ede874df6a5d9483eff9903c3":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"bc0ba910691b4b19a4a28260bda1bb5b":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"caaefa4f6ed04b63923464bd14205406":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_2e18161b4488400e8d7a20dd1eae78fc","IPY_MODEL_00fc7ea916b6498ba219d3c76b0bf6fc","IPY_MODEL_fc43b2ca8e5f4e05a0963ca5b7498e83"],"layout":"IPY_MODEL_bef40506b7854835a5438d6e10e3899f"}},"2e18161b4488400e8d7a20dd1eae78fc":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_1f49957b991b4ef1a609d5e47f354efe","placeholder":"​","style":"IPY_MODEL_120a2dc1b81b457eb024ecdcd1ad4119","value":"Loading weights: 100%"}},"00fc7ea916b6498ba219d3c76b0bf6fc":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_f3f29575b3e8477fa5b33936fdfb2b20","max":200,"min":0,"orientation":"horizontal","style":"IPY_MODEL_f500c8b5fd774f449071eb6a40986584","value":200}},"fc43b2ca8e5f4e05a0963ca5b7498e83":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_60c318ffc1cb491c91ccef001ac07659","placeholder":"​","style":"IPY_MODEL_13473d999c644cfeadd030b2f4c95586","value":" 200/200 [00:00&lt;00:00, 472.21it/s, Materializing param=vit.layernorm.weight]"}},"bef40506b7854835a5438d6e10e3899f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1f49957b991b4ef1a609d5e47f354efe":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"120a2dc1b81b457eb024ecdcd1ad4119":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"f3f29575b3e8477fa5b33936fdfb2b20":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f500c8b5fd774f449071eb6a40986584":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"60c318ffc1cb491c91ccef001ac07659":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"13473d999c644cfeadd030b2f4c95586":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"1b02ffebb8354bd0b00edfdc2fcbb136":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_fd4ee910e32e441c817ec6d70022ce20","IPY_MODEL_ff2c5d60b9274ed481b10d60a18cb0db","IPY_MODEL_70b50b9ad447458ea286c95e676fb846"],"layout":"IPY_MODEL_147f1008718a48aa837a5f7a1d497c1e"}},"fd4ee910e32e441c817ec6d70022ce20":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_504af4c64d964484b17fe27f556946bc","placeholder":"​","style":"IPY_MODEL_80ad6aa57f6244e8b91cb7c07ff5a2d1","value":"model.safetensors: 100%"}},"ff2c5d60b9274ed481b10d60a18cb0db":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_0634c4c5a9cd4318b1b3dde6850be85e","max":346293852,"min":0,"orientation":"horizontal","style":"IPY_MODEL_c6a3150c2fe64324afaaa43ab2509649","value":346293852}},"70b50b9ad447458ea286c95e676fb846":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_b18336bd48054725a0f8a8d25d8dde70","placeholder":"​","style":"IPY_MODEL_1572e0e1a6a74be1b663a7b9b8ab5d8d","value":" 346M/346M [00:03&lt;00:00, 182MB/s]"}},"147f1008718a48aa837a5f7a1d497c1e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"504af4c64d964484b17fe27f556946bc":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"80ad6aa57f6244e8b91cb7c07ff5a2d1":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"0634c4c5a9cd4318b1b3dde6850be85e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"c6a3150c2fe64324afaaa43ab2509649":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"b18336bd48054725a0f8a8d25d8dde70":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1572e0e1a6a74be1b663a7b9b8ab5d8d":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"f7746b359b1f4992bcdabf000352dcef":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_313b32259b7344b1bc8f94e96a7d7732","IPY_MODEL_f63344aed05c497a9066ea42f566cbc0","IPY_MODEL_d631c50477054aaaa5fb47b58c208d84"],"layout":"IPY_MODEL_22f90aeae74a4bacbdb43f7ffe18918f"}},"313b32259b7344b1bc8f94e96a7d7732":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_bebe42fbd6d747be890259410498f0d8","placeholder":"​","style":"IPY_MODEL_438a03f02777481ca0e802e84258c8b0","value":"preprocessor_config.json: 100%"}},"f63344aed05c497a9066ea42f566cbc0":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_eb1a074da83d449bb1d7ef52065d8594","max":276,"min":0,"orientation":"horizontal","style":"IPY_MODEL_f5b23b93cdde4667b9bfaf05684922c5","value":276}},"d631c50477054aaaa5fb47b58c208d84":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_59c18aec266147189fffe9fdef70e05b","placeholder":"​","style":"IPY_MODEL_260ec963c879422f960c98e82bb8ce5b","value":" 276/276 [00:00&lt;00:00, 3.50kB/s]"}},"22f90aeae74a4bacbdb43f7ffe18918f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"bebe42fbd6d747be890259410498f0d8":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"438a03f02777481ca0e802e84258c8b0":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"eb1a074da83d449bb1d7ef52065d8594":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f5b23b93cdde4667b9bfaf05684922c5":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"59c18aec266147189fffe9fdef70e05b":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"260ec963c879422f960c98e82bb8ce5b":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"83c08c4b4e0340d8b27f801d24287ab5":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_f67781a725e34c2fb753995b320ae5f1","IPY_MODEL_7dfb2c4103c245e3b5ab000895c2c844","IPY_MODEL_4dc025bc2ac74e51ae11bdea2aa18ca6"],"layout":"IPY_MODEL_a789e7820fb444c29f14d6b42050e273"}},"f67781a725e34c2fb753995b320ae5f1":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_5780790bc33641a4ba51925b1aa3c5d5","placeholder":"​","style":"IPY_MODEL_a0f0efb3868d46c6b2538f6dd2c45151","value":"config.json: "}},"7dfb2c4103c245e3b5ab000895c2c844":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_3fc35c901f7048e1a82109f4c3e03147","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_d4ca7fac43244406a906490ce302c29a","value":1}},"4dc025bc2ac74e51ae11bdea2aa18ca6":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_6e6a59fa13b04c6498f9576c6d272238","placeholder":"​","style":"IPY_MODEL_1ccd30e408ba42a6b7bdf4fcdde50d25","value":" 69.9k/? [00:00&lt;00:00, 607kB/s]"}},"a789e7820fb444c29f14d6b42050e273":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"5780790bc33641a4ba51925b1aa3c5d5":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a0f0efb3868d46c6b2538f6dd2c45151":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"3fc35c901f7048e1a82109f4c3e03147":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"d4ca7fac43244406a906490ce302c29a":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"6e6a59fa13b04c6498f9576c6d272238":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1ccd30e408ba42a6b7bdf4fcdde50d25":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"73559a849694465392b02d4b5e218c30":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_73f202e37945412a8e779343913d8856","IPY_MODEL_e2ced49b410041b8b2d406c08af723c5","IPY_MODEL_07a810eb852f454a97686414d44f5190"],"layout":"IPY_MODEL_c2fdc21090c94e40b2d116ac5443e52a"}},"73f202e37945412a8e779343913d8856":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_73899a4985ae42d5a250aceac8b09d42","placeholder":"​","style":"IPY_MODEL_08d76879690c450c9e61ffe94ce1a0d3","value":"model.safetensors: 100%"}},"e2ced49b410041b8b2d406c08af723c5":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_add82d4490ea4d76bb97c141b3037435","max":349877750,"min":0,"orientation":"horizontal","style":"IPY_MODEL_924cbcde6cd34e51869decceba17d483","value":349877750}},"07a810eb852f454a97686414d44f5190":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_f79a33aa6757419996eb6fe44bff154a","placeholder":"​","style":"IPY_MODEL_01f90124952e4f65aa366e4f01fcfbcb","value":" 350M/350M [00:05&lt;00:00, 109MB/s]"}},"c2fdc21090c94e40b2d116ac5443e52a":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"73899a4985ae42d5a250aceac8b09d42":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"08d76879690c450c9e61ffe94ce1a0d3":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"add82d4490ea4d76bb97c141b3037435":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"924cbcde6cd34e51869decceba17d483":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"f79a33aa6757419996eb6fe44bff154a":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"01f90124952e4f65aa366e4f01fcfbcb":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"45ed4a10bb3748d19729df977a5bde6d":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_fc27b7613f6e4ec8af8bc0ac4dfb90fe","IPY_MODEL_6ece9583e7b7477bbb01111e20fb4122","IPY_MODEL_47722e52dbd0447eac2c6059c39b9697"],"layout":"IPY_MODEL_f2963c82b3644b6a9d295cb4f531748b"}},"fc27b7613f6e4ec8af8bc0ac4dfb90fe":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_3ad3abddde5a4829950c20e1e3bbfd4d","placeholder":"​","style":"IPY_MODEL_e38a2bdef31b4ff28b3151b2253fcdc0","value":"Loading weights: 100%"}},"6ece9583e7b7477bbb01111e20fb4122":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_93a25a11b11d4df68ff5418e54a812b1","max":221,"min":0,"orientation":"horizontal","style":"IPY_MODEL_19b260a455d544f59ebd641fb98ae3dd","value":221}},"47722e52dbd0447eac2c6059c39b9697":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_8e8e439e7a814b69865270132387ddb5","placeholder":"​","style":"IPY_MODEL_cd19812e083a46889551c3eb951ec2c7","value":" 221/221 [00:00&lt;00:00, 484.95it/s, Materializing param=pooler.layernorm.weight]"}},"f2963c82b3644b6a9d295cb4f531748b":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"3ad3abddde5a4829950c20e1e3bbfd4d":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e38a2bdef31b4ff28b3151b2253fcdc0":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"93a25a11b11d4df68ff5418e54a812b1":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"19b260a455d544f59ebd641fb98ae3dd":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"8e8e439e7a814b69865270132387ddb5":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"cd19812e083a46889551c3eb951ec2c7":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"12d2b8bd2cd04bb294f8d8bcb55fc553":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_24818288a3124d22a4b9bb1f70caaeb8","IPY_MODEL_8b8847b98ed24c4db79f58bee7557336","IPY_MODEL_f8ec11b8d776424986637e81cb57cdcf"],"layout":"IPY_MODEL_17357f329a784eb99c61c90ed01a1d31"}},"24818288a3124d22a4b9bb1f70caaeb8":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_0309f98ec97643f686f1f7c7953b1490","placeholder":"​","style":"IPY_MODEL_6a7cc99728274abfbf02020c2f46dde6","value":"preprocessor_config.json: 100%"}},"8b8847b98ed24c4db79f58bee7557336":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_de47938d9e1a474993e07ca33eda8609","max":255,"min":0,"orientation":"horizontal","style":"IPY_MODEL_25855cf62b9e45458bd278e8ccabd039","value":255}},"f8ec11b8d776424986637e81cb57cdcf":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_bead8c7d0d6d4d99bcc3991caf4cdb96","placeholder":"​","style":"IPY_MODEL_c0eaa3eb7644403ba9448ac925efd56a","value":" 255/255 [00:00&lt;00:00, 18.4kB/s]"}},"17357f329a784eb99c61c90ed01a1d31":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"0309f98ec97643f686f1f7c7953b1490":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"6a7cc99728274abfbf02020c2f46dde6":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"de47938d9e1a474993e07ca33eda8609":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"25855cf62b9e45458bd278e8ccabd039":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"bead8c7d0d6d4d99bcc3991caf4cdb96":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"c0eaa3eb7644403ba9448ac925efd56a":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"2d6aadafc7db47eaa21f3b428db7c7be":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_e24cc75e7b9f44a19ea2d5e390f74613","IPY_MODEL_efc8b0f56c884bea9b5228978d7e489d","IPY_MODEL_67ddcf15d3b04dff983ed3df1a31e198"],"layout":"IPY_MODEL_1a91b1d560ec4196be3365e6f466fb56"}},"e24cc75e7b9f44a19ea2d5e390f74613":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_af9496f327c44834bd09972a263caeb4","placeholder":"​","style":"IPY_MODEL_5b1017a3395848ea80118bcad9dd2db0","value":"config.json: "}},"efc8b0f56c884bea9b5228978d7e489d":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_a5da3b74406a417d906b6ebb5390d55d","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_67df1e5f1a91462f8c7f84844a758a1f","value":1}},"67ddcf15d3b04dff983ed3df1a31e198":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_bef8fc46775b432eb6a6ab016e0fec78","placeholder":"​","style":"IPY_MODEL_37529cce09ff48e49556668d1b3e00a1","value":" 71.8k/? [00:00&lt;00:00, 5.16MB/s]"}},"1a91b1d560ec4196be3365e6f466fb56":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"af9496f327c44834bd09972a263caeb4":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"5b1017a3395848ea80118bcad9dd2db0":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"a5da3b74406a417d906b6ebb5390d55d":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"67df1e5f1a91462f8c7f84844a758a1f":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"bef8fc46775b432eb6a6ab016e0fec78":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"37529cce09ff48e49556668d1b3e00a1":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"a77a3c7a4d3d4f2f884b833a6cac8eef":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_3057883893804b2fbbca149dc28c1d75","IPY_MODEL_db00b68a0af843cf8d915d7fe09521db","IPY_MODEL_f0f17daaf2774e759011f7544033b272"],"layout":"IPY_MODEL_ab27044e403b46228b51e228c50ce1b2"}},"3057883893804b2fbbca149dc28c1d75":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_283c74c4bf8f488c8ca41b666dc810bd","placeholder":"​","style":"IPY_MODEL_5f77fc8f7a06461786f0a820dc58dd64","value":"model.safetensors: 100%"}},"db00b68a0af843cf8d915d7fe09521db":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_cade51c580b24342907d49650ba7e76d","max":113412768,"min":0,"orientation":"horizontal","style":"IPY_MODEL_7a7ec1e6da554c4eb7c364493de7d2be","value":113412768}},"f0f17daaf2774e759011f7544033b272":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_c8e55d6dc3a648a38a6ae4b487892404","placeholder":"​","style":"IPY_MODEL_f49972cd2c234aaca2f399ed5f090bf5","value":" 113M/113M [00:01&lt;00:00, 273MB/s]"}},"ab27044e403b46228b51e228c50ce1b2":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"283c74c4bf8f488c8ca41b666dc810bd":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"5f77fc8f7a06461786f0a820dc58dd64":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"cade51c580b24342907d49650ba7e76d":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"7a7ec1e6da554c4eb7c364493de7d2be":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"c8e55d6dc3a648a38a6ae4b487892404":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f49972cd2c234aaca2f399ed5f090bf5":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"9989f9b0d0444a28af645ecb85448815":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_53066e400a444debadc2991a018de1bc","IPY_MODEL_2714aebc66af4fd2a7b56fbd7412ad72","IPY_MODEL_bb14653f3d5f45d8805c408206f17502"],"layout":"IPY_MODEL_2177c435c25b47d0ab9ecbb94d0e37da"}},"53066e400a444debadc2991a018de1bc":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_ee2dc24eb3a0469c8684d235ffe12ab4","placeholder":"​","style":"IPY_MODEL_9c8c3dfb0d29436cbb73921b1b5a5adf","value":"Loading weights: 100%"}},"2714aebc66af4fd2a7b56fbd7412ad72":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_7f560044381849f9b0230744fb4f49a1","max":233,"min":0,"orientation":"horizontal","style":"IPY_MODEL_9a3c7e7afe214962bd99caf53c29f5d7","value":233}},"bb14653f3d5f45d8805c408206f17502":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_dc3e302063144edc9172968431bdb676","placeholder":"​","style":"IPY_MODEL_39fa1fa9441a4380ac81aba30dd0299b","value":" 233/233 [00:00&lt;00:00, 509.85it/s, Materializing param=swin.layernorm.weight]"}},"2177c435c25b47d0ab9ecbb94d0e37da":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"ee2dc24eb3a0469c8684d235ffe12ab4":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"9c8c3dfb0d29436cbb73921b1b5a5adf":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"7f560044381849f9b0230744fb4f49a1":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"9a3c7e7afe214962bd99caf53c29f5d7":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"dc3e302063144edc9172968431bdb676":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"39fa1fa9441a4380ac81aba30dd0299b":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"149852e4bbd24e9aae020e5f2ed66981":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_bded29baaf6242a1960e03c5134a1139","IPY_MODEL_cad425a29a214cf1adcf15eddd25dffb","IPY_MODEL_ebc4e94fcfbb4445824730f9824e8d3f"],"layout":"IPY_MODEL_0c403fb7cb8a4b3e9b9a339f7f199cec"}},"bded29baaf6242a1960e03c5134a1139":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_097a9e98cd3a4d5bb34c2d68ec942aea","placeholder":"​","style":"IPY_MODEL_dcf12befaab848b993cdfe1f0f495f0b","value":"preprocessor_config.json: 100%"}},"cad425a29a214cf1adcf15eddd25dffb":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_919168cb2cfe4478a16b670929bba1bf","max":316,"min":0,"orientation":"horizontal","style":"IPY_MODEL_e63124aa19044203837db098ec240f2b","value":316}},"ebc4e94fcfbb4445824730f9824e8d3f":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a369a5dac1fc418ebf0f9d92a0b79397","placeholder":"​","style":"IPY_MODEL_0b07e4329d544540becd53010d06b04e","value":" 316/316 [00:00&lt;00:00, 25.2kB/s]"}},"0c403fb7cb8a4b3e9b9a339f7f199cec":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"097a9e98cd3a4d5bb34c2d68ec942aea":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"dcf12befaab848b993cdfe1f0f495f0b":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"919168cb2cfe4478a16b670929bba1bf":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e63124aa19044203837db098ec240f2b":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"a369a5dac1fc418ebf0f9d92a0b79397":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"0b07e4329d544540becd53010d06b04e":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"9e6686baecb04e0f8e791bc10c7c5346":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_48be8da5bd604dd8bb37c7e5a7eddb35","IPY_MODEL_ce48f53cdbb64fec83f38fe25f10e63c","IPY_MODEL_cb9a8514bc5f43fa818d91a88efeba9b"],"layout":"IPY_MODEL_8a5c6724d5244f2ca70a107ae16b9a34"}},"48be8da5bd604dd8bb37c7e5a7eddb35":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_40f6a95e774041dbb7573d4f9f902442","placeholder":"​","style":"IPY_MODEL_d803e50763c84a34a441c6445a13dd29","value":"tokenizer_config.json: 100%"}},"ce48f53cdbb64fec83f38fe25f10e63c":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_234d64de30c64c75b63a948632a4b40a","max":592,"min":0,"orientation":"horizontal","style":"IPY_MODEL_15e417faf04544e2a7f8d91d81bd774c","value":592}},"cb9a8514bc5f43fa818d91a88efeba9b":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_45868a16040b4001aa2dc09fd14b74b1","placeholder":"​","style":"IPY_MODEL_2551c5b57acf4e9e8d3bfd888aed8d66","value":" 592/592 [00:00&lt;00:00, 61.1kB/s]"}},"8a5c6724d5244f2ca70a107ae16b9a34":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"40f6a95e774041dbb7573d4f9f902442":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"d803e50763c84a34a441c6445a13dd29":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"234d64de30c64c75b63a948632a4b40a":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"15e417faf04544e2a7f8d91d81bd774c":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"45868a16040b4001aa2dc09fd14b74b1":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2551c5b57acf4e9e8d3bfd888aed8d66":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"4ec391893079442f8c9cc864203b2e4c":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_2f8487ce28b541ae97c878e191eacf20","IPY_MODEL_39b56994f91147bdba66a67fc10d3066","IPY_MODEL_284a0684b315482fa0d35a4275925533"],"layout":"IPY_MODEL_3f128d7331cb4feebc43b00c8d599879"}},"2f8487ce28b541ae97c878e191eacf20":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a62d1e65550f4ebaab6e5dffbf6c6f0c","placeholder":"​","style":"IPY_MODEL_b24961bc4bbc4430b7690873475d694f","value":"config.json: "}},"39b56994f91147bdba66a67fc10d3066":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_4e8b39d54cc34696b2036f9c43a0125e","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_f3c6ff21761d46439ce54edf69f36481","value":1}},"284a0684b315482fa0d35a4275925533":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_3979a4e086ab4903b57b81d8024784d4","placeholder":"​","style":"IPY_MODEL_42545e2506c749279fff3cebe9e88ec2","value":" 4.19k/? [00:00&lt;00:00, 326kB/s]"}},"3f128d7331cb4feebc43b00c8d599879":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a62d1e65550f4ebaab6e5dffbf6c6f0c":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"b24961bc4bbc4430b7690873475d694f":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"4e8b39d54cc34696b2036f9c43a0125e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"f3c6ff21761d46439ce54edf69f36481":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"3979a4e086ab4903b57b81d8024784d4":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"42545e2506c749279fff3cebe9e88ec2":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"56abd0778f7e4f6295e178a53d398d17":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_a51dfc5457b14746ab9b2f1a4740605f","IPY_MODEL_f1742abe580b4121b9abf3ed8d7f1a65","IPY_MODEL_f8152e5491f746efb088a7f0f84cd6d9"],"layout":"IPY_MODEL_1a3a7b9551c146c78725150b2aeaf235"}},"a51dfc5457b14746ab9b2f1a4740605f":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a393f43fb57f4945a3279df9025895fd","placeholder":"​","style":"IPY_MODEL_97ee9d75477d472f84eb08f84699dcd8","value":"vocab.json: "}},"f1742abe580b4121b9abf3ed8d7f1a65":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_353927350d5d408590cbbe743fc7174a","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_35597e7f9b9d434d83ea87004f59b6f0","value":1}},"f8152e5491f746efb088a7f0f84cd6d9":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_84f3a4dd7aa84d62b87c18b8dd72e261","placeholder":"​","style":"IPY_MODEL_01e9f3cf3cf146b1be521a4a6697fc5b","value":" 862k/? [00:00&lt;00:00, 14.2MB/s]"}},"1a3a7b9551c146c78725150b2aeaf235":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a393f43fb57f4945a3279df9025895fd":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"97ee9d75477d472f84eb08f84699dcd8":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"353927350d5d408590cbbe743fc7174a":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"35597e7f9b9d434d83ea87004f59b6f0":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"84f3a4dd7aa84d62b87c18b8dd72e261":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"01e9f3cf3cf146b1be521a4a6697fc5b":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"951425f2c1c2460185e4cd76660e74a0":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_d7bd5d786245445b9af6a8de5a874267","IPY_MODEL_7551b7030bc64e428c3d8262c0fe2b0e","IPY_MODEL_7ceb50bb60fa4774b6198a932f0fc26c"],"layout":"IPY_MODEL_f55881b0d3144e08b8cf1b97a04ff003"}},"d7bd5d786245445b9af6a8de5a874267":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a9a95224c44641acb058d197b0fa2def","placeholder":"​","style":"IPY_MODEL_1e4bfc3b8e1e443a980a72647469b4a5","value":"merges.txt: "}},"7551b7030bc64e428c3d8262c0fe2b0e":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_0592f35fef324bca830b8cf7790b7a96","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_abe32e47fa934848b3048e7385134613","value":1}},"7ceb50bb60fa4774b6198a932f0fc26c":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_3552f62828e44b8bbd3c27ee875d49d2","placeholder":"​","style":"IPY_MODEL_a3a63f7d493e40538fc8c5aa74e4d407","value":" 525k/? [00:00&lt;00:00, 22.4MB/s]"}},"f55881b0d3144e08b8cf1b97a04ff003":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a9a95224c44641acb058d197b0fa2def":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1e4bfc3b8e1e443a980a72647469b4a5":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"0592f35fef324bca830b8cf7790b7a96":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"abe32e47fa934848b3048e7385134613":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"3552f62828e44b8bbd3c27ee875d49d2":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a3a63f7d493e40538fc8c5aa74e4d407":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"cc536d9a2b964a5d95085e85ee457611":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_ba06f2c6721248d9bc8630155282ab54","IPY_MODEL_f091f86ce34946e6b1b1162c0b8cae1d","IPY_MODEL_bae880cba62945409c4a5b6f9f1ca203"],"layout":"IPY_MODEL_bf6a960802ad4680baea46531e863b57"}},"ba06f2c6721248d9bc8630155282ab54":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_fa9d0c61175646df9b63d2581bcaa132","placeholder":"​","style":"IPY_MODEL_404d2958e98b4844b8a786ed5162a76f","value":"tokenizer.json: "}},"f091f86ce34946e6b1b1162c0b8cae1d":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_28ccdcf822374f788845e03f22c6fbd0","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_450530a6b9984868a9ca958abcc4930b","value":1}},"bae880cba62945409c4a5b6f9f1ca203":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_c07ba48d652f48ac9ad34ff41bd217de","placeholder":"​","style":"IPY_MODEL_1304fc77a54f4dc7b90e2b736e9c3716","value":" 2.22M/? [00:00&lt;00:00, 47.8MB/s]"}},"bf6a960802ad4680baea46531e863b57":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"fa9d0c61175646df9b63d2581bcaa132":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"404d2958e98b4844b8a786ed5162a76f":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"28ccdcf822374f788845e03f22c6fbd0":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"450530a6b9984868a9ca958abcc4930b":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"c07ba48d652f48ac9ad34ff41bd217de":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"1304fc77a54f4dc7b90e2b736e9c3716":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"6cc3534833b44dccb647b8cf90217b7b":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_5ad0ff4146e444b8b84ccf88d2297b87","IPY_MODEL_d19f5e1bffe74555ae3cd75ab097a976","IPY_MODEL_1201f03877834b78bd73eb87be4ed32b"],"layout":"IPY_MODEL_21b46398805549d6bcd0edb5f7ea1f6d"}},"5ad0ff4146e444b8b84ccf88d2297b87":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_dfe451d787db442da00113f11da30538","placeholder":"​","style":"IPY_MODEL_cd741aeecbdd4c6ba7efc1593c7724eb","value":"special_tokens_map.json: 100%"}},"d19f5e1bffe74555ae3cd75ab097a976":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_2774440c72c94b9581d4af81e56ad712","max":389,"min":0,"orientation":"horizontal","style":"IPY_MODEL_8ba33d1dcbb64497814ca20405a88a24","value":389}},"1201f03877834b78bd73eb87be4ed32b":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_6cce18d36ce04c3c91cf6de3103bed67","placeholder":"​","style":"IPY_MODEL_c2c6a8a863f14db58ee64fef79a0bc64","value":" 389/389 [00:00&lt;00:00, 19.1kB/s]"}},"21b46398805549d6bcd0edb5f7ea1f6d":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"dfe451d787db442da00113f11da30538":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"cd741aeecbdd4c6ba7efc1593c7724eb":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"2774440c72c94b9581d4af81e56ad712":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"8ba33d1dcbb64497814ca20405a88a24":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"6cce18d36ce04c3c91cf6de3103bed67":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"c2c6a8a863f14db58ee64fef79a0bc64":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"a92c097be89f4fd697a15d3c0eaff120":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_273c2dd69ae5492d812eec1547dd06e4","IPY_MODEL_ec5585ef887c4df28e01e9de8ee5b763","IPY_MODEL_a3ae59edb5d04655ab082ddf747210a6"],"layout":"IPY_MODEL_0f39295c6f18442f8c4f5438236b8cc2"}},"273c2dd69ae5492d812eec1547dd06e4":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_61711af3c604407299e8e2b0d22152bd","placeholder":"​","style":"IPY_MODEL_150b75d4f25940da8764c669b59c3740","value":"pytorch_model.bin: 100%"}},"ec5585ef887c4df28e01e9de8ee5b763":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_04960b20833e4dc1af60e75c6465214a","max":605247071,"min":0,"orientation":"horizontal","style":"IPY_MODEL_5249ad1244f14ce1adeb5f42cb21fe45","value":605247071}},"a3ae59edb5d04655ab082ddf747210a6":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_5e46ed156b154dca830ac66f1718b659","placeholder":"​","style":"IPY_MODEL_2e3147442ba8411581879ddc19c5b560","value":" 605M/605M [00:03&lt;00:00, 245MB/s]"}},"0f39295c6f18442f8c4f5438236b8cc2":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"61711af3c604407299e8e2b0d22152bd":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"150b75d4f25940da8764c669b59c3740":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"04960b20833e4dc1af60e75c6465214a":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"5249ad1244f14ce1adeb5f42cb21fe45":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"5e46ed156b154dca830ac66f1718b659":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"2e3147442ba8411581879ddc19c5b560":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"19d6e616c847432ba4b605f303692c98":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_f1da0c7e52e04b8c9842618de31e146c","IPY_MODEL_aaa8089bcbf64c858f9e8204ba1e7d47","IPY_MODEL_f5a38435917a4ea9a03336a500a2111d"],"layout":"IPY_MODEL_f8178c307f584ae688182465941523bc"}},"f1da0c7e52e04b8c9842618de31e146c":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_0f18d3deecfc47d0bc4b6d93e5a51475","placeholder":"​","style":"IPY_MODEL_167d7b9b27894d21b523d68f159428d5","value":"model.safetensors: 100%"}},"aaa8089bcbf64c858f9e8204ba1e7d47":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_54810d2290da4c90ae062b5e36b704f1","max":605157884,"min":0,"orientation":"horizontal","style":"IPY_MODEL_5f76c5ed58b64f58b9d4e3fc3d62eb74","value":605157884}},"f5a38435917a4ea9a03336a500a2111d":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_e5ce1d1e14834ef68ecc80c05a72fca6","placeholder":"​","style":"IPY_MODEL_999c5898956549bfbc88869bcaef60fe","value":" 605M/605M [00:10&lt;00:00, 55.7MB/s]"}},"f8178c307f584ae688182465941523bc":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"0f18d3deecfc47d0bc4b6d93e5a51475":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"167d7b9b27894d21b523d68f159428d5":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"54810d2290da4c90ae062b5e36b704f1":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"5f76c5ed58b64f58b9d4e3fc3d62eb74":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"e5ce1d1e14834ef68ecc80c05a72fca6":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"999c5898956549bfbc88869bcaef60fe":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"64c6e6d9bf6248358acc46e87b333c04":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_f52b6aa644cb42e9ba724dba9b5d0484","IPY_MODEL_69e2230c2a0f4502b20cf2d2a1ca63c4","IPY_MODEL_1541d7bb03f04678b9b21a69ba768989"],"layout":"IPY_MODEL_0314147546b54e75b1f951ab81b2d538"}},"f52b6aa644cb42e9ba724dba9b5d0484":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a1defcba2bda4bf29a6d39eabe759049","placeholder":"​","style":"IPY_MODEL_675bca77918646b5bce709210c569513","value":"Loading weights: 100%"}},"69e2230c2a0f4502b20cf2d2a1ca63c4":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_c508178e4155427fb1e22152cb6a4926","max":398,"min":0,"orientation":"horizontal","style":"IPY_MODEL_70356188c49743bb9834fc04dc6334b0","value":398}},"1541d7bb03f04678b9b21a69ba768989":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_377d5d30d4d74c8992559d652ab14c13","placeholder":"​","style":"IPY_MODEL_8efa61f9b3eb42c5a6648a1fe5d0762a","value":" 398/398 [00:02&lt;00:00, 178.41it/s, Materializing param=visual_projection.weight]"}},"0314147546b54e75b1f951ab81b2d538":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a1defcba2bda4bf29a6d39eabe759049":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"675bca77918646b5bce709210c569513":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"c508178e4155427fb1e22152cb6a4926":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"70356188c49743bb9834fc04dc6334b0":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"377d5d30d4d74c8992559d652ab14c13":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"8efa61f9b3eb42c5a6648a1fe5d0762a":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"8d71233139a647fbaf1c6a914e17c0be":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_946f95df73434204b04c60d3211ecca7","IPY_MODEL_716d39516a3048fa896318769d36baf6","IPY_MODEL_6dde28241003443681696c11710e883f"],"layout":"IPY_MODEL_83a48839e9c1419a80062ba8597a4eb1"}},"946f95df73434204b04c60d3211ecca7":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_f302a8a3af2a49d5ac20ed43455722ca","placeholder":"​","style":"IPY_MODEL_3ee14a46973243b89f5885a90b9bf1e0","value":"preprocessor_config.json: 100%"}},"716d39516a3048fa896318769d36baf6":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_b939df4f16654586b153cc0562673aa7","max":316,"min":0,"orientation":"horizontal","style":"IPY_MODEL_cef84ea6917d42698b31232ef019bfc3","value":316}},"6dde28241003443681696c11710e883f":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_34800cb682fd4fa3a6b6100225f1da01","placeholder":"​","style":"IPY_MODEL_694dbfa46cbf4aa4930d53915db7d1f2","value":" 316/316 [00:00&lt;00:00, 4.07kB/s]"}},"83a48839e9c1419a80062ba8597a4eb1":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"f302a8a3af2a49d5ac20ed43455722ca":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"3ee14a46973243b89f5885a90b9bf1e0":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"b939df4f16654586b153cc0562673aa7":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"cef84ea6917d42698b31232ef019bfc3":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"34800cb682fd4fa3a6b6100225f1da01":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"694dbfa46cbf4aa4930d53915db7d1f2":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"ac212f87352a45baaa62a7d810e8d9ea":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_d95670fadbf5455985df00b854d9df41","IPY_MODEL_861ea3420e774628b84c25b7d374759e","IPY_MODEL_e53cc23e76804583b7c409fbb14a73a2"],"layout":"IPY_MODEL_bd86aed1ab984d2c80888155415a6884"}},"d95670fadbf5455985df00b854d9df41":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_3bf098dc68d0496899653f91aa449840","placeholder":"​","style":"IPY_MODEL_71ec22ff0e5a44109c5e41b84316ffb5","value":"tokenizer_config.json: 100%"}},"861ea3420e774628b84c25b7d374759e":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_5eb66efbd8d94e3d8fd2374b7b88d60f","max":905,"min":0,"orientation":"horizontal","style":"IPY_MODEL_ee877b42e35b4f248374e7acfb1d7148","value":905}},"e53cc23e76804583b7c409fbb14a73a2":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_67e2cce6e13741d6b98be054e135c648","placeholder":"​","style":"IPY_MODEL_4dc05e7f76d946dab7f798c1bbd48fde","value":" 905/905 [00:00&lt;00:00, 72.7kB/s]"}},"bd86aed1ab984d2c80888155415a6884":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"3bf098dc68d0496899653f91aa449840":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"71ec22ff0e5a44109c5e41b84316ffb5":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"5eb66efbd8d94e3d8fd2374b7b88d60f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"ee877b42e35b4f248374e7acfb1d7148":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"67e2cce6e13741d6b98be054e135c648":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"4dc05e7f76d946dab7f798c1bbd48fde":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"2dbabe36a939453cab56c4dd30b504e3":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_6b70468278ae4466a13c4e7667971733","IPY_MODEL_ca08eab466c44332a36da8f68db7b0f6","IPY_MODEL_c1c1d839ef824c909e376ca1c6dbeebe"],"layout":"IPY_MODEL_728e62f97cca4eabace68f8ed08dbd94"}},"6b70468278ae4466a13c4e7667971733":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_92b75b3b72594babbeff31a67dce1444","placeholder":"​","style":"IPY_MODEL_d426591c50364b8aaa5a17f8b0ccdaeb","value":"config.json: "}},"ca08eab466c44332a36da8f68db7b0f6":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_49b3c06379fb44dd9c72da46050a143f","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_dcb25d0ce5a5410cb97463fa7d6479e8","value":1}},"c1c1d839ef824c909e376ca1c6dbeebe":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_bb511d3e83e34503b031c9c43db680f7","placeholder":"​","style":"IPY_MODEL_df0ee92d701241b6befcf122137a2571","value":" 4.52k/? [00:00&lt;00:00, 280kB/s]"}},"728e62f97cca4eabace68f8ed08dbd94":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"92b75b3b72594babbeff31a67dce1444":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"d426591c50364b8aaa5a17f8b0ccdaeb":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"49b3c06379fb44dd9c72da46050a143f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"dcb25d0ce5a5410cb97463fa7d6479e8":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"bb511d3e83e34503b031c9c43db680f7":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"df0ee92d701241b6befcf122137a2571":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"02d59ad3f31c4cdaa5605fe480b1da26":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_1e6cc2e6fe1a4d99b743555618d6ffde","IPY_MODEL_aa66086e8d574e8da1160c71e5d20438","IPY_MODEL_d4fca5f002ae4a1ca53258c2e19a80b9"],"layout":"IPY_MODEL_eaa93bee05b642ec957011892dc7b639"}},"1e6cc2e6fe1a4d99b743555618d6ffde":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_72f3d5ebcc8942e09917627568d6417c","placeholder":"​","style":"IPY_MODEL_4b2cbc6848e745a7a3b9c0e00c4f35fe","value":"vocab.json: "}},"aa66086e8d574e8da1160c71e5d20438":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_537db4eef7af4c6d93df80cdfce983ac","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_93018fd2848b4f90a3a546d597e64d30","value":1}},"d4fca5f002ae4a1ca53258c2e19a80b9":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_9847149be2c04a2f877c6d4261539f96","placeholder":"​","style":"IPY_MODEL_ade1d992b8de4c33bf4cfdab796d9572","value":" 961k/? [00:00&lt;00:00, 1.01MB/s]"}},"eaa93bee05b642ec957011892dc7b639":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"72f3d5ebcc8942e09917627568d6417c":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"4b2cbc6848e745a7a3b9c0e00c4f35fe":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"537db4eef7af4c6d93df80cdfce983ac":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"93018fd2848b4f90a3a546d597e64d30":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"9847149be2c04a2f877c6d4261539f96":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"ade1d992b8de4c33bf4cfdab796d9572":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"8024becd7d6c4bec8e5a1865e4663952":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_c15864cab49340c497004c070b6be8e7","IPY_MODEL_b6ebf2f5dc2c4127ba16051e6a3c9c72","IPY_MODEL_585b905863324370bd96e2148a6d4798"],"layout":"IPY_MODEL_9e42359df9ce47f4a6bd331f1db4cf2e"}},"c15864cab49340c497004c070b6be8e7":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a63e7df6fecb4f42bca00f5307fb4b47","placeholder":"​","style":"IPY_MODEL_cf98249bcaf7457fb8e7eb4770c096e0","value":"merges.txt: "}},"b6ebf2f5dc2c4127ba16051e6a3c9c72":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_90211e16ca4a4c498c4510b163c66597","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_54f438a761374a679d4f6aa521807d06","value":1}},"585b905863324370bd96e2148a6d4798":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_070bc2bc921849c3abd9b6f845cdc44e","placeholder":"​","style":"IPY_MODEL_d3161206e593409d932453830cff92e6","value":" 525k/? [00:00&lt;00:00, 856kB/s]"}},"9e42359df9ce47f4a6bd331f1db4cf2e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a63e7df6fecb4f42bca00f5307fb4b47":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"cf98249bcaf7457fb8e7eb4770c096e0":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"90211e16ca4a4c498c4510b163c66597":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"54f438a761374a679d4f6aa521807d06":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"070bc2bc921849c3abd9b6f845cdc44e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"d3161206e593409d932453830cff92e6":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"4eddec051ef84f9abadeb73ba9e25ce7":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_92cf4b3b18b44d3ba203c9aea171873f","IPY_MODEL_0ba52f4643e147c48bd24c8ee0f9a916","IPY_MODEL_383db5a6ee694c9c93c34e0d776444b2"],"layout":"IPY_MODEL_5db45c18a2fd45fb942d2b539a79d373"}},"92cf4b3b18b44d3ba203c9aea171873f":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a4ec67b0d4a2420eb4b2e2cbb2a74c57","placeholder":"​","style":"IPY_MODEL_8e2dc9f2d92542a4bcfaf8369dd07f99","value":"tokenizer.json: "}},"0ba52f4643e147c48bd24c8ee0f9a916":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_3fd646190e184cdcb67e0481f1b144e6","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_2c79d80e138f47c18d202f1bd9924181","value":1}},"383db5a6ee694c9c93c34e0d776444b2":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_9a05b45f215544b3aafb80b63900f975","placeholder":"​","style":"IPY_MODEL_a8ad3b472287485c97821c224c8345b3","value":" 2.22M/? [00:01&lt;00:00, 1.77MB/s]"}},"5db45c18a2fd45fb942d2b539a79d373":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a4ec67b0d4a2420eb4b2e2cbb2a74c57":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"8e2dc9f2d92542a4bcfaf8369dd07f99":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"3fd646190e184cdcb67e0481f1b144e6":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"2c79d80e138f47c18d202f1bd9924181":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"9a05b45f215544b3aafb80b63900f975":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a8ad3b472287485c97821c224c8345b3":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"8c1b0428feda4892ad479a953aff1dfe":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_ee029469728143ffb309831068b0522e","IPY_MODEL_bf34a099be6041969e0df49ea8f0a603","IPY_MODEL_7ca5139b6c5b4bd998081398bb0e6173"],"layout":"IPY_MODEL_cea1053a80c64ec7aac07db9cf0d9253"}},"ee029469728143ffb309831068b0522e":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_6a2d70b1ce544eb1bfc86b41283c35b7","placeholder":"​","style":"IPY_MODEL_6e26ebddd05640ff8c14cbd0b80d8b2c","value":"special_tokens_map.json: 100%"}},"bf34a099be6041969e0df49ea8f0a603":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_8939c6f404ff49a3bdbe4c1485b51eb2","max":389,"min":0,"orientation":"horizontal","style":"IPY_MODEL_53cf831204fc4841840eeef3a78850b3","value":389}},"7ca5139b6c5b4bd998081398bb0e6173":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_6671c778373d4a13961bb2d3cf4c1948","placeholder":"​","style":"IPY_MODEL_388e030beacd40e18e0fd352f7a849e9","value":" 389/389 [00:00&lt;00:00, 34.9kB/s]"}},"cea1053a80c64ec7aac07db9cf0d9253":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"6a2d70b1ce544eb1bfc86b41283c35b7":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"6e26ebddd05640ff8c14cbd0b80d8b2c":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"8939c6f404ff49a3bdbe4c1485b51eb2":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"53cf831204fc4841840eeef3a78850b3":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"6671c778373d4a13961bb2d3cf4c1948":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"388e030beacd40e18e0fd352f7a849e9":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"89a9dd499cf040fea30ac91f856e14dd":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_22252790209f49b19d37455b66e9742b","IPY_MODEL_ef2ae19f915e4575a78e7cf1f1cbb1fe","IPY_MODEL_d74081b9024a4376b66da56aaefcf6c0"],"layout":"IPY_MODEL_4a4023e64fbf4c98b7d56a32b5881ee0"}},"22252790209f49b19d37455b66e9742b":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_31b4929e72f042f3a90ef62b86849b22","placeholder":"​","style":"IPY_MODEL_da03680be2c146eca4ccc8f954e54ee6","value":"model.safetensors: 100%"}},"ef2ae19f915e4575a78e7cf1f1cbb1fe":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_1a6e8cdd0ec043db902a3b173c48dee3","max":1710540580,"min":0,"orientation":"horizontal","style":"IPY_MODEL_10693ab557c94a6d8d19a3f4ab92dbfc","value":1710540580}},"d74081b9024a4376b66da56aaefcf6c0":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_21322cf548914be9a6b0d30ca56f3e3b","placeholder":"​","style":"IPY_MODEL_c87e16f42e8c4ab3b48f9163641f80bf","value":" 1.71G/1.71G [00:09&lt;00:00, 243MB/s]"}},"4a4023e64fbf4c98b7d56a32b5881ee0":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"31b4929e72f042f3a90ef62b86849b22":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"da03680be2c146eca4ccc8f954e54ee6":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"1a6e8cdd0ec043db902a3b173c48dee3":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"10693ab557c94a6d8d19a3f4ab92dbfc":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"21322cf548914be9a6b0d30ca56f3e3b":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"c87e16f42e8c4ab3b48f9163641f80bf":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"26849bd0c3ae4056bd589e7d79196022":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_547d4559a02a486a846d6031bed42d47","IPY_MODEL_2d943cac6e4e409a986678a8e6b8139a","IPY_MODEL_6e057034527546c09b1322ec9f939ed7"],"layout":"IPY_MODEL_d0c1eeee9c124a9285a412a816940f7f"}},"547d4559a02a486a846d6031bed42d47":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_a1e9170dfe79499e976cedbee5283fc8","placeholder":"​","style":"IPY_MODEL_93296bf1853e45d79da67d637c601ac6","value":"Loading weights: 100%"}},"2d943cac6e4e409a986678a8e6b8139a":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_9dd999da10bc4da18476761b63659447","max":590,"min":0,"orientation":"horizontal","style":"IPY_MODEL_b64cab0f7920450b951946986ae71e33","value":590}},"6e057034527546c09b1322ec9f939ed7":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_fd423e63f0f14ece939305926bcbfdac","placeholder":"​","style":"IPY_MODEL_e0117d6c331b40ff9e1b717655ddd7df","value":" 590/590 [00:01&lt;00:00, 607.71it/s, Materializing param=visual_projection.weight]"}},"d0c1eeee9c124a9285a412a816940f7f":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"a1e9170dfe79499e976cedbee5283fc8":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"93296bf1853e45d79da67d637c601ac6":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"9dd999da10bc4da18476761b63659447":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"b64cab0f7920450b951946986ae71e33":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"fd423e63f0f14ece939305926bcbfdac":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e0117d6c331b40ff9e1b717655ddd7df":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"be434cd3424f4345ad9a1eee465bebff":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HBoxModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HBoxView","box_style":"","children":["IPY_MODEL_3360574d9fe74d0aa452c746740c57f4","IPY_MODEL_0d00e1a6dd024948bd281b9327d8c008","IPY_MODEL_ee12bec5377649bc901100669e59343a"],"layout":"IPY_MODEL_427f16d0b1d246438c2070c66472b9c2"}},"3360574d9fe74d0aa452c746740c57f4":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_33eedd5a06274a11b7b270d1560623ef","placeholder":"​","style":"IPY_MODEL_57ad3d3a573044519d981bf32957f715","value":"config.json: "}},"0d00e1a6dd024948bd281b9327d8c008":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"FloatProgressModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"ProgressView","bar_style":"success","description":"","description_tooltip":null,"layout":"IPY_MODEL_ad0220be1b85436a8bbff7f65b107553","max":1,"min":0,"orientation":"horizontal","style":"IPY_MODEL_4e7032609150462cad3bdce6d44f8efe","value":1}},"ee12bec5377649bc901100669e59343a":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_dom_classes":[],"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"HTMLModel","_view_count":null,"_view_module":"@jupyter-widgets/controls","_view_module_version":"1.5.0","_view_name":"HTMLView","description":"","description_tooltip":null,"layout":"IPY_MODEL_8facbfaaa5fb44928301af44370ec4ea","placeholder":"​","style":"IPY_MODEL_e613b2bd211c4e6ea1bbb611904eb14b","value":" 4.10k/? [00:00&lt;00:00, 283kB/s]"}},"427f16d0b1d246438c2070c66472b9c2":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"33eedd5a06274a11b7b270d1560623ef":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"57ad3d3a573044519d981bf32957f715":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}},"ad0220be1b85436a8bbff7f65b107553":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":"20px"}},"4e7032609150462cad3bdce6d44f8efe":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"ProgressStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","bar_color":null,"description_width":""}},"8facbfaaa5fb44928301af44370ec4ea":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_model_module":"@jupyter-widgets/base","_model_module_version":"1.2.0","_model_name":"LayoutModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"LayoutView","align_content":null,"align_items":null,"align_self":null,"border":null,"bottom":null,"display":null,"flex":null,"flex_flow":null,"grid_area":null,"grid_auto_columns":null,"grid_auto_flow":null,"grid_auto_rows":null,"grid_column":null,"grid_gap":null,"grid_row":null,"grid_template_areas":null,"grid_template_columns":null,"grid_template_rows":null,"height":null,"justify_content":null,"justify_items":null,"left":null,"margin":null,"max_height":null,"max_width":null,"min_height":null,"min_width":null,"object_fit":null,"object_position":null,"order":null,"overflow":null,"overflow_x":null,"overflow_y":null,"padding":null,"right":null,"top":null,"visibility":null,"width":null}},"e613b2bd211c4e6ea1bbb611904eb14b":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_model_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_model_name":"DescriptionStyleModel","_view_count":null,"_view_module":"@jupyter-widgets/base","_view_module_version":"1.2.0","_view_name":"StyleView","description_width":""}}}}},"nbformat":4,"nbformat_minor":5}