Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

sync-ggml-26-07-30

talk.llama-coreml

threads

timing

try-fix-abort

whisper-rc-v1.9.4

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3422

#3422

#3423

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3934

#3934

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3947

#3948

#3948

#3950

#3956

#3957

#3959

#3962

#3963

#3964

#3964

#3966

#3969

#3970

#3972

#3975

#3976

#3976

#3977

#3979

#398

#3980

#3980

#3981

#3982

#3985

#3987

#3987

#3989

#3990

#3991

#3994

#3996

#3997

#3998

#3999

#4000

#4001

#4002

#4003

#4004

#4005

#4006

#4007

#4008

#4009

#4010

#4012

#4013

#4015

#4016

#4017

#4019

#4020

#4020

#4021

#4021

#4022

#4023

#4023

#4025

#4028

#4028

#4029

#4029

#4031

#4032

#4033

#4033

#4034

#4035

#4038

#404

#4040

#4044

#4045

#4047

#4048

#4049

#4049

#4050

#4051

#4052

#4053

#4054

#4054

#4055

#4055

#4056

#4057

#4058

#4060

#4061

#4064

#4065

#4066

#4066

#4068

#4068

#4069

#4070

#4072

#4073

#4074

#4077

#4079

#4080

#4082

#4083

#4086

#4086

#4087

#4087

#4089

#4089

#409

#4091

#4091

#41

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

b4938

b5127

b5130

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

v1.9.2

v1.9.3

v1.9.4

Mono Color

• e1bbe40520 ggml-cpu(s390x) : fix q5_1 uninitialized v_acc (llama/28332) Aaron Teo 2026-09-04 13:55:50 +08:00
• d1e0e6491f sycl: fuse rms_norm+mul+add and add+add residual chains (llama/27610) Frosty40 2026-09-03 23:05:40 -05:00
• 36f170e5fe SYCL: Refactor GGML_SYCL_ENABLE_MKL_FA to global var (llama/26863) Ozymandias_EBON 2026-09-03 21:45:53 -05:00
• d784add75f opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations (speculative decoding/MTP) (llama/26477) Hongqiang Wang 2026-09-03 09:46:19 -07:00
• 0a4a95c86e tune MMVQ to MMQ crossover for SM87 (llama/28285) kbenkhaled 2026-09-03 12:40:42 -04:00
• 4dd48dde35 metal : add sparse FA (llama/28098) Georgi Gerganov 2026-09-03 13:51:13 +03:00
• d55d345e69 metal : fix glu dispatch with ne00 = 1 (llama/28306) Georgi Gerganov 2026-09-03 13:25:41 +03:00
• 25350b579e CUDA: Allow concurrent streams per split for multi-GPU (llama/28198) 3 people 2026-09-03 12:03:03 +02:00
• 47d348a278 vulkan: fix FA dequant path engagement (llama/28190) Nathan Wilson 2026-09-03 15:40:34 +07:00
• f24a38605b sycl : enhance the api to support peer-to-peer copy (llama/27550) Neo Zhang 2026-09-03 15:41:07 +08:00
• a704770e3b sycl: reduce redundant work in Q4_K multi-column MMVQ (llama/27062) EurekaticandRaulAbejonDelgado 2026-09-03 08:59:06 +02:00
• e5605697ce finetune: fix no KV cache (llama/27199) Xuan-Son Nguyen 2026-09-02 23:53:32 +02:00
• 37f0f443d7 ggml-hexagon: add F16 support for unary ops (llama/28228) cqderek 2026-09-03 03:59:36 +08:00
• 1bdda1e366 metal : add fa-vec tunings for M3 (llama/28236) Isaac 2026-09-02 23:43:12 +05:30
• 3a1c7d6b6f metal : fix memory query under low-memory conditions (llama/27701) 3 people 2026-09-02 20:09:46 +02:00
• 4d343d7c05 ggml-cuda : remove unused vars (llama/28235) Adrien Gallouët 2026-09-02 18:54:11 +02:00
• 519df618df CUDA + ggml: add sparse-fa for DSV4/GLM (llama/27970) Aman Gupta 2026-09-02 19:57:37 +05:30
• c2b400754b ggml: avoid KleidiAI buffer type init on dispatch (llama/27891) Aman Chadha(IVIXMMI)andAcmmi 2026-09-02 11:46:15 +05:30
• dc70853ec2 hexagon: MUL_MAT and MUL_MAT_ID fusion and fixes (llama/28202) Max Krasnyansky 2026-09-01 23:15:21 -07:00
• 1c7d35e14a vulkan: handle larger batch sizes (>4) efficiently for IQ3_S mat-vec (llama/27449) Laurent ZuijdwijkandMarshall 2026-09-02 07:14:52 +01:00
• a9e58612c5 vulkan : only request VK_KHR_shader_bfloat16 extension if supported (llama/28155) Mads Marquart 2026-09-02 08:13:25 +02:00
• d57ae98246 ggml-cpu : conditionally add SpacemiT IME kernel sources (llama/27961) Alan Tseng 2026-09-02 14:12:28 +08:00
• 35133c94c5 opencl: fix out‐of‐bound reads in the Adreno image kernels (#27632) Hongqiang Wang 2026-09-01 22:28:45 -07:00
• c94921f8c6 hexagon: add missing FARF logs for cpy/get_rows/set_rows/gdn ops (llama/28217) Trivikram Reddy 2026-09-02 00:20:29 -05:00
• fcc2feee2f metal : add metallib build support for xcframework (llama/28163) Jhen-Jie Hong 2026-09-02 07:45:56 +08:00
• 2c486783ab cuda: fuse MoE weighted expert reduction (llama/25952) anujj 2026-09-02 01:18:47 +05:30
• f162a19475 Revert "sycl : add Kronecker product FWHT support for sizes 384, 640, 768, 12…" (#28184) Titaniumtown 2026-09-01 09:04:31 -07:00
• 408faaafce sycl : add Kronecker product FWHT support for sizes 384, 640, 768, 1280 (llama/28016) Jingxin (Philip) Li 2026-09-01 23:47:08 +08:00
• 5f07f856c5 metal : add fa-vec tuning for M2 Pro (llama/28122) Lukasz Stolcman 2026-09-01 15:24:44 +02:00
• 8cca1a3616 metal : add fa-vec tunings for A18 Pro (MacBook Neo) (llama/28152) Jhen-Jie Hong 2026-09-01 21:15:59 +08:00
• a245a8f48f metal : fix more leaks due to missing autoreleasepools (llama/27883) Niklas WenzelandYiChen Lv 2026-09-01 13:50:47 +02:00
• 870db2afa1 metal : add fa-vec tuning for M2 Max (llama/28015) Georgi Gerganov 2026-09-01 13:37:40 +03:00
• 4f3a2a4b79 sycl : support limit max alloc memory within 2GB for host-pinned memory (llama/27559) Neo Zhang 2026-09-01 18:35:47 +08:00
• 5032008bc8 metal: enable Metal 4.0 tensor API on M5+/A19+ (llama/27461) James Francis 2026-09-01 03:02:42 -06:00
• 8e54c659b5 metal : add fa-vec tunings for M1 Ultra (llama/28088) Buğra Özgürsoy 2026-09-01 00:47:27 +03:00
• f22bb2ea4d CUDA: XOR swizzle flash attn K,V smem fp16 tiles (llama/25635) ynankani 2026-08-31 20:18:01 +00:00
• dbc40efce8 metal : add concat support for quantized types (llama/28116) Georgi Gerganov 2026-08-31 23:16:04 +03:00
• 2f608ab4f8 AVX2: Speed up large batch size prompt processing of IQ models (llama/27402) BartowskiandGeorgi Gerganov 2026-08-31 14:33:50 -04:00
• c6934d0fcf metal : add top-k radix implementation (llama/28073) Georgi Gerganov 2026-08-31 21:31:53 +03:00
• 088c603e29 opencl: tune the quant paths for Intel Xe-LP GPUs to improve its TG and PP performance (llama/26438) Hongqiang Wang 2026-08-31 08:56:22 -07:00
• c648b9a4d0 webgpu : avoid crash when offset is not multiple of 4 in WebGPU ggml_backend_tensor_get() implementation (llama/28045) 3 people 2026-08-31 16:04:38 +02:00
• c1be45b890 ROCm: add radix TOP_K for long rows (llama/27466) Jaden_Mach 2026-08-31 09:00:04 -04:00
• 7614a4c139 metal : add fa-vec tunings for M1 (llama/28078) Niklas Wenzel 2026-08-31 13:58:55 +02:00
• b0f4bc02ed CUDA: extend MOE fusion to specdec, earlier MOE glu fusion and topk-router fusion were restricted to 1 token (llama/27621) ynankani 2026-08-31 11:22:28 +00:00
• 76a51e82d7 sycl : Enhance to get the free memory of Intel GPU (llama/27968) Neo Zhang 2026-08-31 18:33:02 +08:00
• 6ce7b89952 vulkan: tune mat-vec rows for batched inference on Strix Halo (llama/27909) Simon Teixidor 2026-08-31 11:07:53 +02:00
• 96dddd87f2 ggml : add MUL_MAT to the list of ops that may need additional memory (for WebGPU) (llama/28071) fairydreamingandStanisław Szymczyk 2026-08-31 10:17:23 +02:00
• db00b0196b vulkan: top_k radix select for k >= 1024 for Qwen 3.8 Flash Next (llama/28032) Ruben Ortlam 2026-08-31 07:04:34 +02:00
• 01ebd225a7 hexagon: fix CPY fence bug (llama/28033) Shenghan Yang 2026-08-31 02:18:24 +08:00
• e5c96ca45d metal : add remaining Q4_1/Q5_0/Q5_1 fa-vec tunings for M2 (llama/28017) codemonkey 2026-08-31 02:00:10 +08:00
• 4089fa628a rpc: avoid serializing buffers from other servers (llama/26500) hmirinandGeorgi Gerganov 2026-08-31 02:26:16 +09:00
• 749683d30f ggml : fix ggml_backend_buft_get_alloc_size() guard (llama/28038) Georgi Gerganov 2026-08-30 20:25:15 +03:00
• e9583f075a ggml: add SWIGLU_CLAMP (llama/27930) Aman Gupta 2026-08-30 20:30:02 +05:30
• e900a732c8 CUDA: use the fast mm_ids_helper path for any n_expert_used (llama/27978) Pascal 2026-08-30 16:06:32 +02:00
• 35d9e2237e hip: tune rdna 3 mmq config (llama/26284) itterative 2026-08-30 13:47:21 +03:00
• e5c9e3e3e9 hip : optimize Q2_0 dot-product path for gfx1201 (llama/26753) LunalFresh 2026-08-30 05:18:36 -05:00
• 4b2243a6c2 ggml : add ggml_backend_op_alloc_size_may_expand, use it in RPC (llama/27960) Georgi Gerganov 2026-08-30 09:17:47 +03:00
• 43acf3d6e8 rpc: fix apple rdma error spew on teardown (llama/27908) Ryan C 2026-08-30 06:16:26 +00:00
• 1e0f382573 metal: add fa-vec tunings for M3 Ultra (llama/27999) Nils Gladitz 2026-08-30 08:06:29 +02:00
• b66593ef1b metal : Add fa-vec tuning for M3 Pro (llama/27963) Daya Adianto 2026-08-30 06:02:22 +00:00
• 5e494599a4 rpc : fix pre-rdma macOS versions (llama/27815) Ryan C 2026-08-30 05:59:25 +00:00
• 3ad8b9b217 hexagon: support for device discovery and create sessions on demand (llama/27785) 4 people 2026-08-29 22:57:55 -07:00
• 3d4e0e9858 sycl: split long rows in TOP_K instead of one work-group per row (llama/27847) Titaniumtown 2026-08-29 22:57:08 -07:00
• c68f20555a metal : fix null-pipeline crash for F16 src1 mul_mat/mul_mat_id (llama/25648) QuintinShaw 2026-08-30 13:56:35 +08:00
• c969c68b54 ggml: allow passing alloc dependencies in graph_optimize (llama/27301) Aman Gupta 2026-08-30 09:04:20 +05:30
• b33bbc5c4e metal : add fa-vec tunings for M2 (llama/27940) codemonkey 2026-08-30 07:44:53 +08:00
• 2a11026cfe opencl: use a better matmul path on two Adreno GPU generations (llama/27640) Hongqiang WangandLi He 2026-08-29 10:46:27 -07:00
• 285f1ffd99 metal : assert shared memory padding (llama/27951) Georgi Gerganov 2026-08-29 17:55:15 +03:00
• 308fa4f8a2 metal : add remaining fa-vec tunings for M4 Pro (llama/27915) Niklas Wenzel 2026-08-29 14:50:13 +02:00
• 325c8d16c1 sycl: make --fit respect --fit-target better (llama/27629) Nick Farrell 2026-08-29 19:00:09 +10:00
• e644752070 vulkan: combine duplicated fastdiv functions, rename the one optimizing small divs (llama/27526) Jeff Bolz 2026-08-29 02:59:48 -05:00
• 590fe18902 metal : add fa-vec tunings for M1 Max (llama/27932) Jhen-Jie Hong 2026-08-29 15:12:23 +08:00
• d501a0a3e8 vulkan: Change mul_mat_id to pad K rather than N (llama/27925) Jeff Bolz 2026-08-29 02:09:24 -05:00
• 4c38040fd3 vulkan: fix missing view-alias dependencies in ggml_vk_graph_optimize (llama/27812) Eric A StaleeandJeff Bolz 2026-08-28 12:12:33 -05:00
• caea96f6ce ggml : fix conv_transpose_2d for multiple batches (llama/26132) Tekin ErtekinandGeorgi Gerganov 2026-08-28 20:09:08 +03:00
• ba99c09866 Vulkan: add hoisting support for row IDs and expert count in shaders (llama/26686) ravel7524andJeff Bolz 2026-08-28 10:52:49 -04:00
• 0a150873ef metal : add fa-vec tunings for M4 (llama/27875) StrongtutandStrongtut 2026-08-28 05:37:37 -07:00
• 7f78e1b469 OpenVINO: Update OV to 2026.3.1, whisper.cpp support, Qwen3.5 on NPU, and new ops (llama/27843) 4 people 2026-08-28 19:42:07 +08:00
• fa4d244c93 sycl: use TILE for quantized KV decode on BMG (llama/26689) Ozymandias_EBON 2026-08-28 03:58:58 -05:00
• 97d0da26a2 sycl: bind the f16 KV cache in place for the oneDNN SDPA path (llama/27468) Titaniumtown 2026-08-28 01:53:31 -07:00
• 530e3f4834 metal : add fa-vec tunings for M3 Max, M5 and M5 Pro (llama/27863) Georgi Gerganov 2026-08-28 11:52:03 +03:00
• ff38b98e5a metal : add fa-vec tunings for M4 Pro (llama/27824) Brad Smith 2026-08-28 04:37:43 -04:00
• b6571e4a55 ggml-hexagon: add HTP unary ops for ABS and LOG (llama/27786) cqderek 2026-08-28 06:05:57 +08:00
• a0614d9ea4 hex-unary: fix RMS_NORM_MUL weight-offset bugs for grouped/broadcast norms (llama/27798) Aparna M P 2026-08-28 03:08:02 +05:30
• 852997152e opencl: add bin kernels kernel_gemm_moe_q4_0_q8_1_dp4a_bin, kernel_gemm_moe_mxfp4_q8_1_dp4a_bin (llama/27768) Shawn Gu 2026-08-27 09:44:05 -07:00
• 55ab1e517c Feature: Added LIGHTNING_INDEXER support for Deepseek V4 ops on Vulkan Backend (llama/27453) Shobhit 2026-08-27 21:34:42 +08:00
• a5db1d66f0 metal : fix memory leaks due to missing autoreleasepools (llama/27758) Niklas Wenzel 2026-08-27 11:53:08 +02:00
• 3fea10db54 hexagon: support for multi-NPU devices (IQ9, IQ10) and fully asynchronous backend (llama/26501) Max Krasnyansky 2026-08-26 18:46:50 -07:00
• 5271734e0e vulkan: warptiles currently assume warp sizes <= 64, clamp to work around larger warps (llama/27726) Ruben Ortlam 2026-08-26 18:02:06 +02:00
• 0a026972da Implemented vulkan cross_entropy_loss and cross_entropy_loss_back (llama/27216) Pranav Uttarkar 2026-08-26 09:49:32 -05:00
• 82f5f85e95 rpc : implement event and async backend APIs (llama/18626) Radoslav Gerganov 2026-08-26 17:34:46 +03:00
• 9d8e6b91b1 cuda: unblock mmq for MoE on sm_60 (llama/26264) David Friehs 2026-08-30 13:01:24 +03:00
• 8c0adb05fe ggml-metal: add chunked SSD MMA for Mamba-2 prefill optimization (llama/26647) 3 people 2026-08-26 01:57:07 -07:00
• 8df657a2fa ggml-meta: propagate buffer usage and call init on the new tensors (llama/27586) Max Krasnyansky 2026-08-25 22:27:51 -07:00
• 482956e744 kleidiai: Rework KleidiAI Build System/Integration (llama/26077) Jonathan Clohessy 2026-08-25 22:07:29 +01:00
• e820c280a6 rpc: support apple RDMA as an RPC transport (llama/26421) Ryan CandRyan Churaman 2026-08-25 17:12:15 +00:00
• be12d39a17 metal : null-check buffer alloc to fix OOM crash (llama/25371) Yuri KhrustalevandGeorgi Gerganov 2026-08-25 07:35:39 -04:00
• 642b5d3260 ruby : Add #free method, check MemoryView strictly (#4032) KITAITI MakotoandDaniel Bevenius 2026-09-04 14:33:37 +09:00
• eacbd8234c whisper : default-initialize whisper_mel to avoid uninitialized read (#3981) Ben Younes 2026-08-31 05:53:57 +02:00
• c4ac0012a8 parakeet : fix TDT decode by outputting raw logits from the joint graph (#4017) Jhen-Jie Hong 2026-08-29 11:28:05 +08:00