|
@@ -29,7 +29,7 @@ mineru -p <input_path> -o <output_path>
|
|
|
mineru -p <input_path> -o <output_path> -b vlm-transformers
|
|
mineru -p <input_path> -o <output_path> -b vlm-transformers
|
|
|
```
|
|
```
|
|
|
> [!TIP]
|
|
> [!TIP]
|
|
|
-> The vlm backend additionally supports `vllm` acceleration. Compared to the `transformers` backend, `vllm` can achieve 20-30x speedup. You can check the installation method for the complete package supporting `vllm` acceleration in the [Extension Modules Installation Guide](../quick_start/extension_modules.md).
|
|
|
|
|
|
|
+> The vlm backend additionally supports `vllm`/`lmdeploy` acceleration. Compared to the `transformers` backend, inference speed can be significantly improved. You can check the installation method for the complete package supporting `vllm`/`lmdeploy` acceleration in the [Extension Modules Installation Guide](../quick_start/extension_modules.md).
|
|
|
|
|
|
|
|
If you need to adjust parsing options through custom parameters, you can also check the more detailed [Command Line Tools Usage Instructions](./cli_tools.md) in the documentation.
|
|
If you need to adjust parsing options through custom parameters, you can also check the more detailed [Command Line Tools Usage Instructions](./cli_tools.md) in the documentation.
|
|
|
|
|
|
|
@@ -48,6 +48,8 @@ If you need to adjust parsing options through custom parameters, you can also ch
|
|
|
mineru-gradio --server-name 0.0.0.0 --server-port 7860
|
|
mineru-gradio --server-name 0.0.0.0 --server-port 7860
|
|
|
# Or using vlm-vllm-engine/pipeline backends (requires vllm environment)
|
|
# Or using vlm-vllm-engine/pipeline backends (requires vllm environment)
|
|
|
mineru-gradio --server-name 0.0.0.0 --server-port 7860 --enable-vllm-engine true
|
|
mineru-gradio --server-name 0.0.0.0 --server-port 7860 --enable-vllm-engine true
|
|
|
|
|
+ # Or using vlm-lmdeploy-engine/pipeline backends (requires lmdeploy environment)
|
|
|
|
|
+ mineru-gradio --server-name 0.0.0.0 --server-port 7860 --enable-lmdeploy-engine true
|
|
|
```
|
|
```
|
|
|
>[!TIP]
|
|
>[!TIP]
|
|
|
>
|
|
>
|
|
@@ -55,8 +57,12 @@ If you need to adjust parsing options through custom parameters, you can also ch
|
|
|
|
|
|
|
|
- Using `http-client/server` method:
|
|
- Using `http-client/server` method:
|
|
|
```bash
|
|
```bash
|
|
|
- # Start vllm server (requires vllm environment)
|
|
|
|
|
- mineru-vllm-server --port 30000
|
|
|
|
|
|
|
+ # Start openai compatible server (requires vllm or lmdeploy environment)
|
|
|
|
|
+ mineru-openai-server
|
|
|
|
|
+ # Or start vllm server (requires vllm environment)
|
|
|
|
|
+ mineru-openai-server --engine vllm --port 30000
|
|
|
|
|
+ # Or start lmdeploy server (requires lmdeploy environment)
|
|
|
|
|
+ mineru-openai-server --engine lmdeploy --server-port 30000
|
|
|
```
|
|
```
|
|
|
>[!TIP]
|
|
>[!TIP]
|
|
|
>In another terminal, connect to vllm server via http client (only requires CPU and network, no vllm environment needed)
|
|
>In another terminal, connect to vllm server via http client (only requires CPU and network, no vllm environment needed)
|
|
@@ -65,8 +71,8 @@ If you need to adjust parsing options through custom parameters, you can also ch
|
|
|
> ```
|
|
> ```
|
|
|
|
|
|
|
|
> [!NOTE]
|
|
> [!NOTE]
|
|
|
-> All officially supported vllm parameters can be passed to MinerU through command line arguments, including the following commands: `mineru`, `mineru-vllm-server`, `mineru-gradio`, `mineru-api`.
|
|
|
|
|
-> We have compiled some commonly used parameters and usage methods for `vllm`, which can be found in the documentation [Advanced Command Line Parameters](./advanced_cli_parameters.md).
|
|
|
|
|
|
|
+> All officially supported `vllm/lmdeploy` parameters can be passed to MinerU through command line arguments, including the following commands: `mineru`, `mineru-openai-server`, `mineru-gradio`, `mineru-api`.
|
|
|
|
|
+> We have compiled some commonly used parameters and usage methods for `vllm/lmdeploy`, which can be found in the documentation [Advanced Command Line Parameters](./advanced_cli_parameters.md).
|
|
|
|
|
|
|
|
## Extending MinerU Functionality with Configuration Files
|
|
## Extending MinerU Functionality with Configuration Files
|
|
|
|
|
|