Releases: microsoft/onnxruntime-genai
Releases · microsoft/onnxruntime-genai
Release list
v0.15.2
v0.15.1
v0.15.0
What's Changed
- Add per_layer_inputs support for Gemma4 and fix pixel_position_ids by Akshay Sonawane (@apsonawane) in #2188
- Enable Qwen3.5 35B-A3B MoE text export for TRT-RTX EP by Yen-Shi Wang (@yen-shi) in #2186
- Multilingual model ids expansion in the sample/example based on new Nvidia's README by Nenad Banfic (@nenad1002) in #2190
- Fix webgpu shared buffer issue by Akshay Sonawane (@apsonawane) in #2191
- Fix nightly build by kunal-vaishnavi in #2193
- Clean up base constructor in model builder by kunal-vaishnavi in #2192
- Fix CUDA illegal memory access crash in TopK when inputs contain NaN by David Fan (@jiafatom) in #2195
- Fix: Skip CPU provider in SetProviderSessionOptions by David Fan (@jiafatom) in #2179
- Add README file for testing folder by kunal-vaishnavi in #2205
- Add real-model integration test pipeline by Baiju Meswani (@baijumeswani) in #2198
- Update Extensions for Harmony/GPT-OSS Tool Calling Support by Sayan Shaw (@sayanshaw24) in #2200
- Forward user provider options to allocator init session by Jiajia Qin (@qjia7) in #2177
- Add grid dimension validation by Akshay Sonawane (@apsonawane) in #2219
- Support Hunyuan Dense V1 export by Sunghoon Choi (@hanbitmyths) in #2189
- Fix model builder for gpt-oss by Tianlei Wu (@tianleiwu) in #2228
- Update main to version 0.15.0 by Baiju Meswani (@baijumeswani) in #2183
- Build onnxruntime-genai-cuda packages on win-arm64 by Baiju Meswani (@baijumeswani) in #2199
- Bump torch from 2.7.1+cpu to 2.12.0+cpu in /test/python/directml/torch by Dependabot (@dependabot)[bot] in #2230
- Fix BFloat16 logits returned as garbage in Logits::Get() by Justin Chu (@justinchuby) in #2203
- Fix DefaultKeyValueCache: per-layer num_kv_heads for Gemma 4 dual/MQA attention by shreyshah-microsoft in #2214
- Fix security vulnerabilities by Akshay Sonawane (@apsonawane) in #2224
- Fix divide by zero error by Akshay Sonawane (@apsonawane) in #2226
- Load models from ONNX Runtime model packages by Jambay Kinley (@jambayk) in #2227
- fix(ci): use new identity client ID by Sanaa Hamel (@sanaa-hamel-microsoft) in #2246
- Use Linux A10 Agents for Integration Tests by Baiju Meswani (@baijumeswani) in #2248
- Fix OrtGlobals::Allocator destruction order by Edward Chen (@edgchen1) in #2249
- Add validation for input data by Akshay Sonawane (@apsonawane) in #2220
- Add upper bounds to dependencies by Akshay Sonawane (@apsonawane) in #2221
- Add check for malformed audio files by Akshay Sonawane (@apsonawane) in #2225
- Route init-session provider-option shaping through DeviceInterface by Jiajia Qin (@qjia7) in #2232
- Release captured graph resources when generator is destroyed by Jiajia Qin (@qjia7) in #2106
- feat: add audio content blocks for Gemma multimodal prompts in model_mm by Chang Liu (@cliu1003) in #2240
- Fix tied embeddings by kunal-vaishnavi in #2237
- Enable zero-copy for QNN GPU by qti-mattsinc in #2105
- fix(ci): use GHCR instead of ACR for workflow docker caches by Sanaa Hamel (@sanaa-hamel-microsoft) in #2264
- Fix new-delete-type-mismatch in C API opaque handle destroy functions by Akshay Sonawane (@apsonawane) in #2271
- Add regression tests for top_k exceeding vocab_size by David Fan (@jiafatom) in #2265
- Add bounds checking to OgaSequencesGetSequence C API functions by David Fan (@jiafatom) in #2260
- webgpu: fix RecurrentState graph capture with shared buffer aliasing by Jiajia Qin (@qjia7) in #2244
- Reject vocab_size < 2 for beam search to fix OOB in BeamSearch_Cpu::SelectTop by David Fan (@jiafatom) in #2272
- Update trust_remote_code by Akshay Sonawane (@apsonawane) in #2256
- Validate eos_token_id against vocab_size to prevent OOB write in ApplyMinLength by David Fan (@jiafatom) in #2266
- Fix use-after-free by making GeneratorParams co-own its Model by David Fan (@jiafatom) in #2270
- Fix arbitrary dll load via json injection by Akshay Sonawane (@apsonawane) in #2269
- Resolve model package paths and path-valued session options through ONNX Runtime by Jambay Kinley (@jambayk) in #2255
- Fall back to the system D3D12 runtime when the Agility SDK device factory cannot create a device by Gianluca Mazza (@gianlucamazza) in #2280
- Support UpdatePositionIds in webgpu's interface by Jiajia Qin (@qjia7) in #1952
- Fix UAF in adapter lifecycle: serialize Adapters ops with a mutex by Akshay Sonawane (@apsonawane) in #2274
- Fix AppendNextTokensToSequences heap overflow by Akshay Sonawane (@apsonawane) in #2111
- hack(ci): temporarily disable GHCR cache by Sanaa Hamel (@sanaa-hamel-microsoft) in #2297
- Enable re-init after OgaShutdown by Scott McKay (@skottmckay) in #2292
- Add int8 precision support to model builder by danielsongmicrosoft in #2275
- DML: allow opting out of graph capture via provider option by Gianluca Mazza (@gianlucamazza) in #2300
- Detect model packages by manifest.json without a root genai_config.json by Jambay Kinley (@jambayk) in #2298
- Add multi_rotary_cache_concat_offset for Phi-4 model in TRT-RTX EP by Yen-Shi Wang (@yen-shi) in #2276
- LFM2: add shared-buffer KV cache support to LFM2Cache by Tachion (@SanjayAMD) in #2284
- Update model builder for gpt-oss by Tianlei Wu (@tianleiwu) in #2234
- Support transformers v5 rope_parameters in model builder by Tianlei Wu (@tianleiwu) in #2311
- TurboQuant for ORT WebGPU along with model_bechmark updates to measure GPU memory by Sushanth Rajasankar (@sushraja-msft) in #2084
- Use lintrunner to format all files by Tianlei Wu (@tianleiwu) in #2317
- Bump torch from 2.7.1+cpu to 2.12.1+cpu in /test/python/cpu/torch by Dependabot (@dependabot)[bot] in #2305
- Bump torch from 2.12.0+cpu to 2.12.1+cpu in /test/python/directml/torch by Dependabot (@dependabot)[bot] in #2303
- [WebGPU] implements webgpu support in benchmarking script by Prathik Rao (@prathikr) in #2318
- Roll onnxruntime-extensions to pick up Gemma4LogMel OOB fix (#1092) by Sushanth Rajasankar (@sushraja-msft) in #2320
- Fix DML readback size by Sushanth Rajasankar (@sushraja-msft) in #2319
- Update torch package versions for CIs by kunal-vaishnavi in #2322
- chore(ci): use new integration test pool on Linux by Sanaa Hamel (@sanaa-hamel-microsoft) in #2254
- Implement no_repeat_ngram_size for CPU search by Mustapha Jaber (@mustjab) in #2242
- Add GetMemoryInfo to DeviceInterface by qti-mattsinc in #2259
- Support both FP16 and FP32 I/O for Nemotron by Anatol Liu (@p3achyjr) in #2279
- Drop CWD fallback in custom_ops_library resolution by Akshay Sonawane (@apsonawane) in #2267
- Redesign unified packaging pipeline by Baiju Meswani (@baijumeswani) in #2310
- Bump requests from 2.32.3 to 2.33.0 by Dependabot (@dependabot)[bot] in #2323
- [WebGPU] append WebGPUExecutionProvider to config by Prathik Rao (@prathikr) in #2326
- Add address validation feature by Akshay Sonawane (@apsonawane) in #2223
- Update prechecks in model builder by kunal-vaishnavi in #2312
- Remove onnxruntime-genai-cuda.dll from foundry package win-arm64 rid by Baiju Meswani (@baijumeswani) in #2329
- Add Tool Cal...
v0.14.0
What's Changed
- Fix WhisperProcessor divide-by-zero when single prompt is provided by @Copilot in #2068
- Fix lm_head tensor loading order dependency in quantized model builder by Thiago Pereira Rocha (@thpereir) in #2061
- Fail to build Whisper model by Xiaofei Han (@xiaofeihan1) in #2075
- Rename NemotronCacheConfig to NemotronConfig and add blank penalty to the decoder by Nenad Banfic (@nenad1002) in #2042
- Fix YaRN RoPE bugs in model builder and add parity tests by Ti-Tai Wang (@titaiwangms) in #2076
- Add Transformers v5 Support by Sayan Shaw (@sayanshaw24) in #2089
- macOS ARM64 ADO pipeline by @Copilot in #2091
- Reduce CPU-side per-token overhead in GenerateNextToken and SampleTopP by Sunghoon Choi (@hanbitmyths) in #2085
- Add onStageComplete by Akshay Sonawane (@apsonawane) in #2074
- [WebGPU] Support continuous decoding (RewindTo) with graph capture by Jiajia Qin (@qjia7) in #2083
- [Mistral3] Add VLM support with multi-image inference by Ti-Tai Wang (@titaiwangms) in #2077
- Add k_quant_linear mixed-precision quantization for hybrid attention … by Akshay Sonawane (@apsonawane) in #2100
- Removes QNN packaging from onnxruntime-genai pipelines by Baiju Meswani (@baijumeswani) in #2109
- Add Gemma4 multimodal support (vision + audio) by Akshay Sonawane (@apsonawane) in #2103
- Update GUIDs during az login by kunal-vaishnavi in #2122
- Add CODEOWNERS file for repository ownership by kunal-vaishnavi in #2119
- Qwen3.5: drop fp32 cast around RMSNorm in builder by Xiaofei Han (@xiaofeihan1) in #2101
- Add support for LFM2 in ORT GenAI by Joshua Lochner (@xenova) in #1979
- Enable CUDA graph capture for CUDA EP to improve decode throughput by Akshay Sonawane (@apsonawane) in #2070
- [Qwen3.5] dedup position ids by Jianhui Dai (@daijh) in #2102
- Address win-cuda pipeline errors by Baiju Meswani (@baijumeswani) in #2154
- Update Extensions Commit to Fix Id2Token Bugs by Sayan Shaw (@sayanshaw24) in #2159
- Limit the CUDA cmake architectures to 86 for CI builds by Baiju Meswani (@baijumeswani) in #2161
- Gate leaked-object error reporting in Shutdown() to debug builds or when logging is enabled by Baiju Meswani (@baijumeswani) in #2162
- Update Copilot instructions for reviewing model builder by kunal-vaishnavi in #2164
- Fix DecoderState input_ids check regression introduced in #2103 by Ti-Tai Wang (@titaiwangms) in #2148
- Fix memory leaks by Scott McKay (@skottmckay) in #2153
- [Qwen3.5] Use LpNormalization for L2-norm in linear-attention Q/K by Xiaofei Han (@xiaofeihan1) in #2127
- Fix: Win32 build failure when paths contain spaces by NSubaru (@nsubaru) in #2053
- Fix CUDA build with MSVC by enabling /Zc:preprocessor for nvcc host compilation on VS 16.5 or greater by NSubaru (@nsubaru) in #2054
- Apply linear rope_scaling in model builder for Neutts/nano by Vishal Jain (@VishalX) in #2142
- Fix Quark/AWQ weight loading for Qwen3-VL-4B text model by anilmartha in #2143
- Fix WebGPU inference crash in embedding and multi-modal feature allocation by Fei Chen (@feich-ms) in #2163
- Support Visual Studio 18 2026 build by @Copilot in #2017
- Add QNN EP documentation to OGA including Genie note by Kyle Romero (@qti-kromero) in #2158
- Use windowsml package and make winml usage simpler by Baiju Meswani (@baijumeswani) in #2155
- Cleanup TensorObject created by OrtxTensorResultGetAt by Scott McKay (@skottmckay) in #2168
- Fix nemotron leaks by Scott McKay (@skottmckay) in #2169
- [RyzenAI] make speech sub-model optional in PhiMultiModalProcessor by manasablrm in #2167
- Enable graph capture for WebGPU models and DML continuous decoding tests by Jiajia Qin (@qjia7) in #2099
- [Qwen3] Allow packed QKV MatMul under QK-Norm via post-MatMul Split by Xiaofei Han (@xiaofeihan1) in #2137
- Enable Linux ARM64 builds and packaging by Baiju Meswani (@baijumeswani) in #2107
- Add gemma4 unit tests by Akshay Sonawane (@apsonawane) in #2151
- Auto-detect fixed kv-cache shape in DefaultKeyValueCache by Oleksandr Kholodnyi (@akholodnamdcom) in #2166
- Add text-only mode support for Qwen 3.5 model builder by Akshay Sonawane (@apsonawane) in #2157
- Fix heap overflow issue by Akshay Sonawane (@apsonawane) in #2110
- [Benchmark] Add --use_random_tokens flag to C benchmark by Vishal Jain (@VishalX) in #2170
- Add HunYuan Dense V1 (hunyuan_v1_dense) model support by anilmartha in #2144
- Nvidia Parakeet Tdt ASR support by Nenad Banfic (@nenad1002) in #2150
- Multilingual Streaming Nemotron ASR + CUDA support by Nenad Banfic (@nenad1002) in #2171
- Add Csharp binding for Multi-lingual ASR by Rui Ren (@rui-ren) in #2176
- Add VideoChat-Flash (OpenGVLab) language model support by anilmartha in #2147
- Update Nemotron ASR docs by Rui Ren (@rui-ren) in #2178
- Validate sliding window size before creating KV cache by Baiju Meswani (@baijumeswani) in #2181
- Fix external weights loading for in-memory models without changing cwd by Baiju Meswani (@baijumeswani) in #2180
- Enable Qwen3.5 TRT-RTX EP path with CUDA graph by Yen-Shi Wang (@yen-shi) in #2139
- Add Qwen3.5-MoE (35B-A3B) model support by tanzeel-amd in #2146
- Update ort-extensions commit by Baiju Meswani (@baijumeswani) in #2182
New Contributors
- Ti-Tai Wang (@titaiwangms) made their first contribution in #2076
- NSubaru (@nsubaru) made their first contribution in #2053
- Vishal Jain (@VishalX) made their first contribution in #2142
- anilmartha made their first contribution in #2143
- Fei Chen (@feich-ms) made their first contribution in #2163
- Kyle Romero (@qti-kromero) made their first contribution in #2158
- manasablrm made their first contribution in #2167
- Yen-Shi Wang (@yen-shi) made their first contribution in #2139
- tanzeel-amd made their first contribution in #2146
Full Changelog: v0.13.1...v0.14.0
v0.13.2
v0.13.1
v0.13.0
What's Changed
- update WebGPU buffer memory info name by Yulong Wang (@fs-eire) in #1957
- Add
enable_profilingin Runtime Options by Xiaofei Han (@xiaofeihan1) in #1949 - Fix uninitialized tools variable and improve exception debug messages by sheller-ms (@sheller-ms) in #1971
- Add common download to Phi-3 tutorial by kunal-vaishnavi in #1973
- Add support for InternLM2 model architecture by Rajeev Patwari (@amdrajeevp1) in #1958
- Update cmake cuda architecture and use win-arm64 pool workaround by Baiju Meswani (@baijumeswani) in #1976
- Update examples after 0.12.0 release by kunal-vaishnavi in #1980
- Add CI pipeline for WebGPU EP model testing by Jiajia Qin (@qjia7) in #1956
- Fix Python nightly build by kunal-vaishnavi in #1981
- Add missing Quark 0.11 weight patterns for ChatGLM3 output layer by Pooja Ganesh (@poganesh) in #1983
- Support Qwen2.5-VL pre-quantized models in qwen.py by Pooja Ganesh (@poganesh) in #1985
- [VitisAI] external_ep_libray support fix for WinML by Oleksandr Kholodnyi (@akholodnamdcom) in #1984
- Fix guidance bug by Baiju Meswani (@baijumeswani) in #1988
- Fix incorrect batch responses when using multiple prompts by lnigam in #1986
- Enable webgpu graph capture in base.py by Jiajia Qin (@qjia7) in #1991
- Harden CUDA error checking across the codebase by @Copilot in #1994
- allow pruned models for prefill by Yulong Wang (@fs-eire) in #1995
- Fix WinML Packaging Pipeline by Baiju Meswani (@baijumeswani) in #1998
- Add small changes after pruning prefill by kunal-vaishnavi in #2000
- webgpu: Optimize Copyfrom by Jiajia Qin (@qjia7) in #1992
- Add support for CUDA 13 by Baiju Meswani (@baijumeswani) in #2001
- add webgpu to qmoe path by Guenther Schmuelling (@guschmue) in #2005
- Fix ERNIE 4.5 model builder: rope_attrs and config architecture name by xiaoyao9184 (@xiaoyao9184) in #2007
- Bug fix in Continuous Decoding by chilukam-qti in #2008
- Update Phi-4 mm README links by kunal-vaishnavi in #2014
- Add Qwen3-VL model support + multi-image input support in Qwen VL family by Sunghoon Choi (@hanbitmyths) in #2003
- Add Qwen3.5 model support and optimize multi-image handling by Akshay Sonawane (@apsonawane) in #2019
- Reuse a single generator via RewindTo(0) in benchmark instead of creating multiple generators by Jiajia Qin (@qjia7) in #2002
- [RyzenAI] WinML compatibility fix by Oleksandr Kholodnyi (@akholodnamdcom) in #2026
- Nemotron ASR Support for Streaming by Nenad Banfic (@nenad1002) in #1997
- [WebGPU] Fix the prefill regression when graph capture is ON by Jiajia Qin (@qjia7) in #2021
- Support 4 inputs for nemotron model by David Fan (@jiafatom) in #2036
- Updated java packaging based on python packaging logic by EPNW-Eric in #2029
- Fix android packaging pipeline by Baiju Meswani (@baijumeswani) in #2039
- Add OpenAI's Whisper to model builder by kunal-vaishnavi in #2018
- [Java] Add a dependency on onnxruntime (#2030) by EPNW-Eric in #2040
- Fix mutually exclusive inputs for language models by kunal-vaishnavi in #2046
- Decouple plugin execution providers (EPs) from the USE_WINML pre-processor macro by Baiju Meswani (@baijumeswani) in #2038
- Route pipeline model RunOptions through SetRunOption for proper special key handling by @Copilot in #2044
- Add ort_build_version and ort_build_source parameters to nuget and python packaging pipelines, remove ROCm support by @Copilot in #2049
- Add batched multi-image vision path and window_size config for Qwen VL by Sunghoon Choi (@hanbitmyths) in #2050
- docs: fix formatting and syntax highlighting in documentation by @riddles-the-one in #2051
- Add Silero VAD Support to Nemotron Streaming ASR by Sayan Shaw (@sayanshaw24) in #2035
- Add Qwen3.5 hybrid decoder export support (GatedDeltaNet + Attention) by Akshay Sonawane (@apsonawane) in #2043
- Add support for QNN stateful models by Ashima Jain (@qti-ashimaj) in #2012
- Allocate recurrent state via device allocator to enable CUDA graph capture by Akshay Sonawane (@apsonawane) in #2057
- Speed up CI pipelines by @Copilot in #2052
- Fix tool calling for TRT-RTX models by kunal-vaishnavi in #2048
- Fix vision pipeline EP hardcoding and pixel_values rank mismatch for Qwen VL models by Akshay Sonawane (@apsonawane) in #2060
New Contributors
- sheller-ms (@sheller-ms) made their first contribution in #1971
- Rajeev Patwari (@amdrajeevp1) made their first contribution in #1958
- Pooja Ganesh (@poganesh) made their first contribution in #1983
- xiaoyao9184 (@xiaoyao9184) made their first contribution in #2007
- chilukam-qti made their first contribution in #2008
- EPNW-Eric made their first contribution in #2029
Full Changelog: v0.12.0...v0.13.0
v0.12.2
- Update examples after 0.12.0 release
- Add missing Quark 0.11 weight patterns for ChatGLM3 output layer
- Support Qwen2.5-VL pre-quantized models in qwen.py
- Fix incorrect batch responses when using multiple prompts
- Harden CUDA error checking across the codebase
- allow pruned models for prefill
- Add small changes after pruning prefill
v0.12.1
v0.12.0
What's Changed
- Update versions after making 0.11.0 branch by kunal-vaishnavi in #1867
- Fix guidance usage in continuous decoding by kunal-vaishnavi in #1870
- Fix HelloPhi C# example by kunal-vaishnavi in #1871
- Fix regex by Akshay Sonawane (@apsonawane) in #1875
- Update extensions commit by Akshay Sonawane (@apsonawane) in #1874
- Revert removal of eps_without_if_support by Xiaofei Han (@xiaofeihan1) in #1878
- Fix condition for NPU by Akshay Sonawane (@apsonawane) in #1880
- Model builder refactoring by Tianlei Wu (@tianleiwu) in #1862
- Add lintrunner to format code by Tianlei Wu (@tianleiwu) in #1884
- Remove empty submodule leftover. by xkszltl in #1883
- Fix build for lack of RTLD_DI_ORIGIN support by Jaeyoon Jung (@jaeyoonjung) in #1888
- Enable graph capture for webgpu by Jiajia Qin (@qjia7) in #1848
- Generic shared emb_tokens/lm_head implementation by Jixiong Deng (@jixiongdeng) in #1885
- Fix bug in Squeeze for getting the value of total_seq_len by Wanming Lin (@Honry) in #1886
- Extra_options
disable_qkv_fusionto untie qkv_projs from upstream choice by Jixiong Deng (@jixiongdeng) in #1893 - Fix mac pipeline by Akshay Sonawane (@apsonawane) in #1904
- whisper: Support a variant of the whisper pipeline where encoder / decoder are stateful. by Ryan Metcalfe (@RyanMetcalfeInt8) in #1857
- Add model builder for Qwen2_5_VLTextModel by Tianlei Wu (@tianleiwu) in #1882
- Integrate FARA-7B model by Akshay Sonawane (@apsonawane) in #1902
- Fix gpt-oss model export by Akshay Sonawane (@apsonawane) in #1861
- OpenVINO: Add support for model caching via 'cache_dir' provider option by Ryan Metcalfe (@RyanMetcalfeInt8) in #1900
- WinML - Remove the inclusive Microsoft.WindowsAppSDK.ML range check by Chris Dern (@chrisdMSFT) in #1907
- Run the model in text mode by Akshay Sonawane (@apsonawane) in #1908
- Update extensions commit by Akshay Sonawane (@apsonawane) in #1914
- Fix gpt-oss export by Akshay Sonawane (@apsonawane) in #1915
- Support Olive new uint8 quantization format by Xiaoyu (@xiaoyu-work) in #1916
- Disable CUDA graph for Phi LongRoPE models with IF nodes on TRT-RTX by anujj in #1921
- Add support for CUDA and CPU arch for Qwen-2.5-VL and Fara-7B by Akshay Sonawane (@apsonawane) in #1919
- Add Gemma-3 vision tutorial to ONNX Runtime GenAI by kunal-vaishnavi in #1793
- Quark GPT-OSS support by Thiago Pereira Rocha (@thpereir) in #1903
- Fix sliding window alignment regression in QNN models by Akshay Sonawane (@apsonawane) in #1938
- AMD RyzenAI EP Support by Oleksandr Kholodnyi (@akholodnamdcom) in #1935
- Update README by Nat Kershaw (MSFT) (@natke) in #1934
- [RyzenAI] Non-pruned models backward compatibility by Oleksandr Kholodnyi (@akholodnamdcom) in #1942
- [VitisAI] EP loader by Oleksandr Kholodnyi (@akholodnamdcom) in #1918
- Set default top_k and top_p if it is None by Xiaoyu (@xiaoyu-work) in #1944
- Ensure dlls are signed in the c and nuget packages. by Baiju Meswani (@baijumeswani) in #1947
- Bump torch from 2.7.1 to 2.7.1+cpu in /test/python/directml/torch by Dependabot (@dependabot)[bot] in #1868
- Add linker flags for 16 KB page size on Android by sheetalarkadam in #1860
- Only manually load DLLs if onnxruntime.dll is not already loaded. by Feng Wang (@chemwolf6922) in #1800
- Add a doc showing how to run GPT OSS 20B with WebGPU by Nat Kershaw (MSFT) (@natke) in #1945
- Add C#, Java, and Objective-C APIs for Config by kunal-vaishnavi in #1946
- Fix GatherBlockQuantized node to support symmetric quantized LM_HEAD by Sushanth Rajasankar (@sushraja-msft) in #1951
- Fix QMoE blockwise quantization support for TRT-RTX execution provider by anujj in #1926
- Revert "Add a doc showing how to run GPT OSS 20B with WebGPU" by kunal-vaishnavi in #1950
- Add custom model path support for unit tests by mpasumarthi-git in #1917
- fix: patch
llguidanceto remove reference toringcrate by Sanaa Hamel (@sanaa-hamel-microsoft) in #1948 - Implement graph models for EPs by Jiajia Qin (@qjia7) in #1895
- Update handling EOS token id detection by kunal-vaishnavi in #1925
- Remove onnxruntime-genai-cuda from the foundry package by Baiju Meswani (@baijumeswani) in #1954
- Include linux builds in the foundry ort-genai package by Baiju Meswani (@baijumeswani) in #1955
- Support pre-registered plug-in NvTensorRtRtx execution provider library by anujj in #1889
- [RyzenAI] Linux compatibility fixes by Oleksandr Kholodnyi (@akholodnamdcom) in #1959
- Use cuda 12.8 to build ort-genai by Baiju Meswani (@baijumeswani) in #1960
- Bump protobuf from 5.29.5 to 6.33.5 in /test/python by Dependabot (@dependabot)[bot] in #1961
- Add RAII wrappers for ORT Model Editor API types by Jiajia Qin (@qjia7) in #1953
- Rewrite all examples using standardization by kunal-vaishnavi in #1939
- Add versioning to the onnxruntime-genai-cuda.dll by Baiju Meswani (@baijumeswani) in #1965
- [Build][Packaging] macOS packaging to skip building x86_64 by Baiju Meswani (@baijumeswani) in #1966
- Sync packaging changes with ONNX Runtime by Baiju Meswani (@baijumeswani) in #1967
- Release 0.12.0 cherry-pick PR by Baiju Meswani (@baijumeswani) in #1978
New Contributors
- xkszltl made their first contribution in #1883
- Jaeyoon Jung (@jaeyoonjung) made their first contribution in #1888
- Jixiong Deng (@jixiongdeng) made their first contribution in #1885
- Wanming Lin (@Honry) made their first contribution in #1886
- Thiago Pereira Rocha (@thpereir) made their first contribution in #1903
- Oleksandr Kholodnyi (@akholodnamdcom) made their first contribution in #1935
- sheetalarkadam made their first contribution in #1860
- Sanaa Hamel (@sanaa-hamel-microsoft) made their first contribution in #1948
Full Changelog: v0.11.4...v0.12.0