Update README.md
Browse files
README.md
CHANGED
|
@@ -15,7 +15,11 @@ datasets:
|
|
| 15 |
|
| 16 |
## Model Usage
|
| 17 |
### With OpenCLIP
|
| 18 |
-
#### Note:
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
```
|
| 20 |
import torch
|
| 21 |
import torch.nn.functional as F
|
|
|
|
| 15 |
|
| 16 |
## Model Usage
|
| 17 |
### With OpenCLIP
|
| 18 |
+
#### Note:
|
| 19 |
+
#### 1. We made modifications to the tokenizer implementation in open_clip/tokenizer.py.
|
| 20 |
+
#### 2. Due to differences in the default epsilon values for LayerNorm initialization between JAX and PyTorch, we adjusted the default epsilon value in open_clip/transformer.py to align the model's behavior.
|
| 21 |
+
#### For more details, refer to https://github.com/UCSC-VLAA/CLIPS.
|
| 22 |
+
|
| 23 |
```
|
| 24 |
import torch
|
| 25 |
import torch.nn.functional as F
|