Skip to content

Pull requests: scaleapi/llm-engine

New pull request New
37 Open 664 Closed
37 Open 664 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Config: support IPv4 bind host for inference servers
#757 opened Feb 13, 2026 by dustinrubin5050 Loading…
add qwen3-8b-instruct as supported model
#756 opened Feb 12, 2026 by lukasewecker Loading…
fix various cases of synchronous code blocking event loop
#755 opened Feb 11, 2026 by olliestanley Loading…
5
Add task_expires_seconds for async endpoint task expiration
#754 opened Feb 11, 2026 by lukasewecker Loading…
4
cpu only endpoints
#751 opened Jan 31, 2026 by dmchoiboi Loading…
Revert openai schema back to 3.0.0
#740 opened Dec 18, 2025 by lilyz-ai Loading…
Share controller 20251206 133239
#736 opened Dec 6, 2025 by Shreyasg13 Loading…
🚧 Add queue_message_timeout_duration parameter to endpoints (from older TASMU base commit)
#731 opened Dec 1, 2025 by ValentineDragan • Draft
[PSP-449] Add on-prem support to model-engine
#725 opened Oct 28, 2025 by TarunRavikumar Loading…
5
[MLI-4966] Launch support multiple routes passthrough
#722 opened Oct 14, 2025 by meher-m Loading…
@meher-m
Vllm batch upgrade
#715 opened Sep 24, 2025 by dmchoiboi • Draft
1
Add configurable queue_message_timeout_duration parameter in endpoint service configs
#709 opened Sep 16, 2025 by ValentineDragan • Draft
1
changed host flag to be 0.0.0.0 to be compatible with both ipv4 and ipv6
#707 opened Sep 12, 2025 by andytang-scale Loading…
1
Enhance model engine with max concurrency support for sync endpoints
#701 opened Aug 24, 2025 by saeidbarati-scale Loading…
on prem changes to disable cloud solutions
#700 opened Aug 18, 2025 by jen-scymanski-scale Loading…
21
multinode readme changes and remove logs
#697 opened Jun 7, 2025 by meher-m • Draft
deepseek multinode and no logging
#696 opened Jun 6, 2025 by meher-m • Draft
Update celery forwarder to use greenlets instead of processes
#689 opened Mar 1, 2025 by dmchoiboi Loading…
2
[GCP] Aagamdalal/sgp 3575 model engine update pubsub model engine code
#686 opened Feb 18, 2025 by AaDalal Loading…
[GCP] Update artifact registry/db code
#685 opened Feb 13, 2025 by AaDalal Loading…
5
Google Cloud Storage Integration
#683 opened Feb 3, 2025 by anishxyz Loading…
11
Update setup.py
#662 opened Nov 20, 2024 by anagnoko23 Loading…
Bump setuptools from 69.0.3 to 70.0.0 in /model-engine dependencies Pull requests that update a dependency file
#565 opened Jul 15, 2024 by dependabot bot Loading…
Bump zipp from 3.16.0 to 3.19.1 in /model-engine dependencies Pull requests that update a dependency file
#559 opened Jul 9, 2024 by dependabot bot Loading…
Bump certifi from 2023.7.22 to 2024.7.4 in /model-engine dependencies Pull requests that update a dependency file
#557 opened Jul 6, 2024 by dependabot bot Loading…
ProTip! Exclude everything labeled bug with -label:bug.