| | --- |
| | license: mit |
| | license_link: https://huggingface.co/huihui-ai/phi-4-abliterated/resolve/main/LICENSE |
| | language: |
| | - en |
| | base_model: huihui-ai/phi-4-abliterated |
| | pipeline_tag: text-generation |
| | tags: |
| | - phi |
| | - nlp |
| | - math |
| | - code |
| | - chat |
| | - conversational |
| | - abliterated |
| | - uncensored |
| | - mlx |
| | - mlx-my-repo |
| | inference: |
| | parameters: |
| | temperature: 0 |
| | widget: |
| | - messages: |
| | - role: user |
| | content: How should I explain the Internet? |
| | library_name: transformers |
| | --- |
| | |
| | # mlx-community/phi-4-abliterated-2bit |
| |
|
| | The Model [mlx-community/phi-4-abliterated-2bit](https://huggingface.co/mlx-community/phi-4-abliterated-2bit) was converted to MLX format from [huihui-ai/phi-4-abliterated](https://huggingface.co/huihui-ai/phi-4-abliterated) using mlx-lm version **0.20.5**. |
| |
|
| | ## Use with mlx |
| |
|
| | ```bash |
| | pip install mlx-lm |
| | ``` |
| |
|
| | ```python |
| | from mlx_lm import load, generate |
| | |
| | model, tokenizer = load("mlx-community/phi-4-abliterated-2bit") |
| | |
| | prompt="hello" |
| | |
| | if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None: |
| | messages = [{"role": "user", "content": prompt}] |
| | prompt = tokenizer.apply_chat_template( |
| | messages, tokenize=False, add_generation_prompt=True |
| | ) |
| | |
| | response = generate(model, tokenizer, prompt=prompt, verbose=True) |
| | ``` |
| |
|