File size: 2,375 Bytes
dcf454d 16a41a8 dcf454d f43de5f dcf454d 913868b 7bf3603 dcf454d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 |
---
license: bsd-3-clause
language:
- en
base_model:
- depth-anything/DA3-SMALL
- depth-anything/DA3-BASE
- depth-anything/DA3MONO-LARGE
- depth-anything/DA3METRIC-LARGE
pipeline_tag: depth-estimation
tags:
- Depth-Anything-3
---
# Depth-Anything-3
This version of Depth-Anything-3 has been converted to run on the Axera NPU using **w8a16** quantization.
This model has been optimized with the following LoRA:
Compatible with Pulsar2 version: 5.0-patch1
## Convert tools links:
For those who are interested in model conversion, you can try to export axmodel through
- [The repo of original](https://github.com/ByteDance-Seed/Depth-Anything-3)
- [The repo of AXera Platform](https://github.com/AXERA-TECH/Depth-Anything-3.AXERA.git), which you can get the detial of guide
- [Pulsar2 Link, How to Convert ONNX to axmodel](https://pulsar2-docs.readthedocs.io/en/latest/pulsar2/introduction.html)
## Support Platform
- AX650
- [M4N-Dock(爱芯派Pro)](https://wiki.sipeed.com/hardware/zh/maixIV/m4ndock/m4ndock.html)
- [M.2 Accelerator card](https://axcl-docs.readthedocs.io/zh-cn/latest/doc_guide_hardware.html)
- AX637
|Chips|Models |Time|
|--|--|--|
|AX650|da3-base|67.341 ms |
|AX650|da3-small|22.768 ms |
|AX650|da3metric-large|217.577 ms |
|AX650|da3mono-large|217.615 ms |
|AX637|da3-base|174.100 ms |
|AX637|da3-small|75.802 ms |
|AX637|da3metric-large|698.765 ms |
|AX637|da3mono-large|697.891 ms |
## How to use
Download all files from this repository to the device
### python env requirement
#### pyaxengine
https://github.com/AXERA-TECH/pyaxengine
```
wget https://github.com/AXERA-TECH/pyaxengine/releases/download/0.1.3.rc2/axengine-0.1.3-py3-none-any.whl
pip install axengine-0.1.3-py3-none-any.whl
```
#### others
Maybe None.
#### Inference with AX650 Host, such as M4N-Dock(爱芯派Pro)
Input image:
```
root@ax650:~/AXERA-TECH/Depth-Anything-3# python3 python/infer.py --model models/da3metric-large.axmodel --img examples/demo01.jpg
[INFO] Available providers: ['AxEngineExecutionProvider']
[INFO] Using provider: AxEngineExecutionProvider
[INFO] Chip type: ChipType.MC50
[INFO] VNPU type: VNPUType.DISABLED
[INFO] Engine version: 2.12.0s
[INFO] Model type: 2 (triple core)
[INFO] Compiler version: 3.3 ae03a08f
root@ax650:~/AXERA-TECH/Depth-Anything-3# ls
```
Output image:
|