Week 5
June 06/30/23
- Colab
- In the current Colab Pro subscription, we spend 10$/month which gets us 100 credits a month.
- Credits which aren't used, only get carried for 3 months in total.
- So the maximum number of credits, we can have in our account is 300 credits.
| Config | Available RAM |
|---|
| High RAM | 25GB |
| Regular | 12GB |
| Runtime | RAM | Credits used/per hr |
|---|
| Standard (no GPU) | Regular | 0.08 |
| Standard (no GPU) | High RAM | 0.12 |
| A100 (40 GB) | Regular | 13.47 |
| A100 (40 GB) | High RAM | 13.36 |
| V100 (16 GB) | Regular | 5.36 |
| V100 (16 GB) | High RAM | 5.45 |
| T4 (16 GB) | Regular | 1.96 |
| T4 (16 GB) | High RAM | 2.05 |
June 06/27/23
- Download files from Google Drive
- Download
rclone on the MSI server - Follow the instructions in the
https://rclone.org/drive/ to configure the Google Drive - Test the connection to download 1-2 jpg files from
Drive to the local system. - Once satisified, use the
rclone copy command to download files from the remote (Google Drive) directly to the local system (external drive) mounted on the MSI server
June 06/26/23
- There are a lot of models available on the ChatAll app.
- They are all invoked programmatically. Looking at the source, it is invoked in the same fashion as the Bard API by hacking (making a fake Web request and then render on the frontend).
- All the available code to make such a request on the ChatAll app is written in Javascript.
| Available Models in the ChatALL | Description | How is it called | Comment |
|---|
| ChatGPT | requires authentication | mimics a browser request | |
| GPT-3.5 | paid | invoked through a API key | we have this key |
| GPT-4 | paid | invoked through a API key | we have this key |
| Bing Chat | requires authentication | mimics a browser request | |
| HuggingChat | requires authentication | mimics a browser request | |
| Vicuna-13b | requires authentication | mimics a browser request | |
| claude | requires authentication | mimics a browser request | |
With all the available code in the ChatAll app, we need a way to convert this javascript code to Python and then use it in our solution.
In the mean time, I'll write the code to have it ping GPT-3.5 using our key.