Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

talk.llama-coreml

threads

timing

try-fix-abort

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3419

#3422

#3422

#3423

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3931

#3934

#3934

#3936

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3946

#3947

#3948

#3948

#3950

#3950

#398

#404

#409

#41

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

Mono Color

• 080bbbe852 examples : Remove leading space from txt output (#3921) master Cappuccino 2026-07-11 23:53:59 +08:00
• 7695a53312 ggml : use ggml_vqtbl1q_u8 for 32-bit compat (#0) Georgi Gerganov 2026-07-10 11:06:42 +03:00
• 289ecb05c9 talk-llama : sync llama.cpp Georgi Gerganov 2026-07-10 10:41:19 +03:00
• afa6bffd2b sync : ggml Georgi Gerganov 2026-07-10 10:36:00 +03:00
• 4fc2a2d922 ggml : bump version to 0.16.0 (ggml/1559) Georgi Gerganov 2026-07-10 10:25:06 +03:00
• 6b17d2c05f ggml : fix conv 2d dw (llama/25490) Georgi Gerganov 2026-07-09 17:56:32 +03:00
• ade3292d03 common : adapt to q2_0 (ggml/0) Georgi Gerganov 2026-07-09 14:58:55 +03:00
• a2c50280d8 Only index by compile times + always multiply/add (llama/25445) Oliver Simons 2026-07-09 13:23:57 +02:00
• 9cd788e703 metal : add CONV_2D_DW (depthwise convolution) support (llama/21565) Sou-ly 2026-07-09 18:29:15 +09:00
• cc7a521508 ggml-hip: enable -funsafe-math-optimizations (llama/24668) RapidMark 2026-07-09 01:02:26 -07:00
• 1b0b078a98 cuda: align snake fusion matcher with the other backends (llama/25460) Pascal 2026-07-09 10:00:06 +02:00
• def36a5831 hexagon: add VISION RoPE support (llama/25216) Aparna M P 2026-07-09 10:25:00 +05:30
• 4b914096e8 ggml-webgpu: tune subgroup split (d_split) in flash_attn_vec (llama/25418) Masashi Yoshimura 2026-07-09 08:34:19 +09:00
• 8e7b672fb4 opencl: Q6_K GEMM/GEMV fix for ne01 of weights that are not multiples of 128. (llama/25464) Hongqiang Wang 2026-07-08 15:52:21 -07:00
• b47f39dba2 vulkan: disable FA mask_opt on GCN to improve performance (llama/24362) Ruben Ortlam 2026-07-08 19:01:25 +02:00
• 5f052fbfaf opencl: ragged-tile MoE prefill FP16 GEMM optimization (skip padded expert tiles) (llama/25433) Hongqiang Wang 2026-07-08 09:44:55 -07:00
• 06492a14a3 vulkan: for small AMD GPUs, reduce submission threshold based on CU count (llama/25240) Ruben Ortlam 2026-07-08 18:15:18 +02:00
• 50e0adb702 hexagon: new vtcm layouts and improved pipelines for MUL_MAT, MUL_MAT_ID and FLASH_ATTN_EXT (llama/25425) Max Krasnyansky 2026-07-08 07:38:27 -07:00
• b83d1671db cuda : add support for f16->f16 GGML_OP_SET_ROWS (llama/25367) fairydreaming 2026-07-08 13:24:20 +02:00
• 81c8bb90df metal : add set_rows with src0 f16 (llama/25434) fairydreaming 2026-07-08 08:49:07 +02:00
• 3d521d1bd8 ggml : fix A indexing in simd_gemm scalar tail-column path (llama/25390) tyronecai 2026-07-08 13:00:05 +08:00
• 72e3f210f3 ggml : add support for CPU f16->f16 GGML_OP_SET_ROWS (llama/25344) fairydreaming 2026-07-08 05:46:28 +02:00
• 75f1f0c063 opencl: fix potential crash in aos reconstruct (llama/25383) lhez 2026-07-07 20:34:29 -07:00
• 66e178ec84 Add Q2_0 quantization: type definition and CPU backend (llama/24448) Pasha Khosravi 2026-07-07 12:05:47 -07:00
• 2061e3b6bf CUDA: Fuse MMVQ post-scale for NVFP4 (llama/24481) Oliver Simons 2026-07-07 17:12:19 +02:00
• 38d16b9a7e ggml-hip : add -fno-finite-math-only alongside -ffast-math (llama/25373) asf0 2026-07-07 05:27:50 -06:00
• 7c04837122 fix unsupported UT cases of CONT & CPY (llama/25231) Neo Zhang 2026-07-07 17:20:52 +08:00
• bcbc5bc554 support op col2im_1d (llama/25264) Neo Zhang 2026-07-07 16:07:46 +08:00
• a0b8896847 support OP cross_entropy_loss, cross_entropy_loss_back (llama/25236) Neo Zhang 2026-07-07 15:48:50 +08:00
• e1d865d834 sycl : set K_QUANTS_PER_ITERATION to 1 on DMMV path (llama/25063) Todd Malsbary 2026-07-07 00:43:41 -07:00
• 120fc3729d fix unsupport ACC UT cases for noncontiguous (llama/25124) Neo Zhang 2026-07-07 15:40:38 +08:00
• bfd86f4304 sycl : enhance argsort to support all UT cases (llama/25125) Neo Zhang 2026-07-07 15:39:29 +08:00
• f353a27988 sycl : use sycl func to fix AOT double type issue (llama/25081) Neo Zhang 2026-07-07 15:38:33 +08:00
• 2c6e470ced sycl : rename the env vars from "disable" to "enable" (llama/25042) Neo Zhang 2026-07-07 15:33:51 +08:00
• 753e101595 ggml : make ggml_time_init idempotent (llama/24422) An Long 2026-07-07 16:29:17 +09:00
• bd5ce1ed48 vulkan : check src0 type in GGML_OP_SET_ROWS to avoid failures due to unimplemented f16 support (llama/25351) fairydreaming 2026-07-07 06:56:02 +02:00
• 3a1387caf8 opencl: general flash attention decode performance optimizations (llama/25366) Hongqiang Wang 2026-07-06 19:57:52 -07:00
• 91ca310157 metal: add col2im_1d op (f32/f16/bf16) (llama/25176) Pascal 2026-07-06 20:47:36 +02:00
• 3f05208e5c CUDA: remove -sm row, refactor cuBLAS (llama/24216) Johannes Gäßler 2026-07-06 20:04:53 +02:00
• 82ac928a5d CUDA: extend K-type validation to V-types for flash attention (llama/24403) Alexey Kopytko 2026-07-06 23:26:50 +09:00
• 7d8e64fe37 ggml-cpu: use UE4M3 LUT in ARM NVFP4 dot product (llama/25331) ragz4125 2026-07-06 16:36:40 +05:30
• ce2c003f17 ggml-cpu: Enable tiled matmul on AIX (llama/25199) shalinib-ibm 2026-07-06 15:48:17 +05:30
• 2ec3883df0 vulkan: fix 32-bit integer overflow in CEIL_DIV (llama/25245) hokanosekai 2026-07-06 10:35:57 +02:00
• 9fe449cbd0 ggml-hip: enable -ffast-math for HIP builds (llama/23862) a-huk 2026-07-06 09:02:26 +02:00
• ec6e0f2c29 ggml-cuda: optimize conv_transpose_1d indexing (llama/25310) adavyas 2026-07-05 20:49:06 -07:00
• 38c6260238 abort if we see a multi buffer (llama/25276) Eve 2026-07-05 18:38:47 +00:00
• f6f1252b05 ggml : fix tensor-parallel + -ncmoe crash on MoE models (llama/25028) liminfei-amd 2026-07-06 01:56:11 +08:00
• 1222c01f0e ggml: Update VMM Pool allocation ggml-cuda.cu - Turing P2P access fix (fixes #24489) (llama/24491) Vexxie 2026-07-05 18:10:09 +01:00
• 93cff36f15 cuda : concat implementation for quantized types (llama/25303) fairydreaming 2026-07-05 17:26:24 +02:00
• 0a58b4b546 ggml : fix broken CPU concat implementation for quantized types (llama/25247) fairydreaming 2026-07-04 13:37:37 +02:00
• b28289008c cuda: enable topk-moe fusion for 288 experts (llama/25267) Piotr Wilkin (ilintar) 2026-07-03 15:36:55 +02:00
• 28ef70c68c Remove redundant CUDA copies after gated_delta_net. (llama/23940) Gaurav Garg 2026-07-03 14:36:29 +05:30
• 759197a754 opencl: allow loading precompiled binary kernels from library (llama/23042) lhez 2026-07-01 10:29:22 -07:00
• cae089f4a1 hexagon: flash attention rework (optimizations, accuracy improvements, etc) (llama/25085) Max Krasnyansky 2026-07-01 06:59:19 -07:00
• 388a1fc962 CUDA: consistent use of __restrict__ + PDL for FA (llama/25185) Johannes Gäßler 2026-07-01 10:55:14 +02:00
• dd1c9a552b ggml-cpu: add AVX2 optimization for nvfp4 dot product and use UE4M3 LUT (llama/23961) ragz4125 2026-07-01 13:01:20 +05:30
• 9804f9736c opencl: initial q1_0 support (llama/25160) lhez 2026-06-30 21:43:20 -07:00
• 52302312e6 cuda : prevent integer truncation and overflow errors when using KQ mask strides in flash_attn_mask_to_KV_max kernel (llama/24945) fairydreaming 2026-06-30 20:47:05 +02:00
• 63285ff81f CUDA: fix get_rows_back for tables with more than 65535 rows (grid-y clamp + stride) (llama/25103) Matt Jallo 2026-06-30 05:16:24 -07:00
• 2b35abc294 CUDA: fix Gemma E4B MTP FlashAttention (llama/25148) Johannes Gäßler 2026-06-30 14:06:54 +02:00
• 899c7ed4ac vulkan: roll bk loop in matmul for asahi linux (llama/24663) Kevin Liu 2026-06-30 06:27:38 -04:00
• 2ea7a752af HIP: use hipBLAS for dense prefill on gfx900, keep MMQ for MoE (llama/24588) zduford 2026-06-30 05:51:38 -04:00
• b313fd3ce8 ggml-webgpu: add support for NVFP4 (llama/25143) Masashi Yoshimura 2026-06-30 17:20:04 +09:00
• 7999638e04 Revert "sched : reintroduce less synchronizations during split compute (#20793)" (llama/25138) Oliver Simons 2026-06-30 02:41:45 +02:00
• ba36235565 vulkan: use flops instead of weight tensor size for submission heuristic (llama/25005) Ruben Ortlam 2026-06-29 15:24:44 +02:00
• 5f51daf516 opencl: flash attention improvement (llama/25069) Hongqiang Wang 2026-06-27 15:36:06 -07:00
• 868367609f Added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy (llama/25057) Gaurav Garg 2026-06-27 17:46:21 +05:30
• a4ac1c0369 sycl : fix failed ut cases of norm (llama/25044) Neo Zhang 2026-06-27 17:13:43 +08:00
• d54eb4fe2e vulkan: fix step operator for 0 input (llama/25036) Ruben Ortlam 2026-06-27 10:57:31 +02:00
• e4234013e9 sched : reintroduce less synchronizations during split compute (llama/20793) Andreas Kieslinger 2026-06-26 16:18:30 +02:00
• 3e97b98452 openvino: Update to OV 2026.2.1, self-contained release packages, operator improvements (llama/24974) Ravi Panchumarthy 2026-06-26 05:07:19 -07:00
• c497d75e00 vulkan: opt mul_mat_vecq for mi50 (llama/22933) nullname 2026-06-26 19:49:24 +08:00
• 1c8ea5fb92 vulkan: add INTEL_XE1 arch enum and enable coopmat1 on Intel Xe-LPG Plus (llama/24404) Jiang, Fish 2026-06-26 11:26:22 +00:00
• 6fc7c33b4c whisper : expose internal VAD speech segments (#3916) Lin Xiaodong 2026-07-01 19:10:16 +08:00
• 167d225f3a ci, examples : add package-lock.json to examples addon node (#3919) Daniel Bevenius 2026-07-01 09:04:21 +02:00
• 5cad7abb1e whisper : map token timestamps to original time when VAD is enabled (#3910) Lin Xiaodong 2026-07-01 14:23:50 +08:00
• 909307c8bd whisper : make voice_length() utf-8 aware for CJK (#3915) Lin Xiaodong 2026-07-01 14:21:35 +08:00
• 0874de3e8e ci : set GGML_NATIVE=OFF for sanitize builds (#3920) Daniel Bevenius 2026-06-30 17:47:22 +02:00
• 65dc3fece6 examples : Improved inference performance of Android example project (#3913) Yongmin Yoo 유용민 2026-06-30 19:12:04 +09:00
• 0ae02cdb2c talk-llama : sync llama.cpp Georgi Gerganov 2026-06-26 15:06:05 +03:00
• 0279b5386a sync : ggml Georgi Gerganov 2026-06-26 15:05:10 +03:00
• 974db58c5f ggml : bump version to 0.15.3 (ggml/1550) Georgi Gerganov 2026-06-26 14:37:43 +03:00
• df03e266f1 vulkan: Workaround compiler bug in conv2d coopmat2 path (llama/24924) Jeff Bolz 2026-06-26 04:53:32 -05:00
• b564d5364a CUDA: add cublasSgemmBatched mapping for HIP/MUSA vendor headers (llama/25033) leonardHONG 2026-06-26 17:42:56 +08:00
• 5e7ef7e4b0 ggml-cpu: fix SVE leftover path in ggml_vec_dot_f32 (llama/24699) Tarek Dakhran 2026-06-26 09:41:56 +02:00
• 02be871218 sycl : clamp softmax input to avoid underflow (llama/24941) Jassieluo 2026-06-26 15:02:42 +08:00
• 96996579f0 CUDA: batch out_prod broadcast (dps2>1) path with cublasSgemmBatched (llama/24426) leonardHONG 2026-06-26 13:51:25 +08:00
• 7ce3616ae8 opencl: flush profiling batch at shutdown for incomplete batches (llama/25016) shaofeiqi 2026-06-25 18:48:24 -07:00
• 9cad795918 CUDA: Various fixes to cpy.cu (llama/25000) Oliver Simons 2026-06-25 17:29:23 +02:00
• 82686b518f ggml : address integer overflows in binary ops CUDA implementation (llama/24706) fairydreaming 2026-06-25 10:06:44 +02:00
• ffd5b0b5c7 sycl : support --split-mode tensor (llama/24152) David Spruill 2026-06-25 01:35:21 -04:00
• c4ba5e2e13 sycl : fix the failed UT cases of conv_3d (llama/24900) Neo Zhang 2026-06-25 13:27:58 +08:00
• fe37d2e489 opencl: support non-contig rows in norm (llama/24965) lhez 2026-06-24 19:21:25 -07:00
• e0a0f1256f hexagon: MUL_MAT and MUL_MAT_ID rework : 32x32 tiled weight repack, kernel-params, cached graphs (llama/24954) Max Krasnyansky 2026-06-24 12:14:25 -07:00
• a201c20505 vulkan: allow reducing the graph submission batches to avoid timeouts (llama/24872) Wagner Bruna 2026-06-24 11:29:24 -03:00
• f081d84a4e vulkan: fail the build when a shader fails to compile (llama/24450) liminfei-amd 2026-06-24 17:42:03 +08:00
• 792da0ecdb vulkan: Apply bias before softmax in FA, to avoid overflow (llama/24909) Jeff Bolz 2026-06-23 22:34:00 -05:00
• 3fc2c57a63 vulkan: support all backend tests for SQR/SQRT/SIN/COS/CLAMP/LEAKY_RELU/NORM (llama/24582) Jeff Bolz 2026-06-23 09:48:24 -05:00
• 1fdbfb19eb vulkan: Support GET_ROWS_BACK (llama/24883) Jeff Bolz 2026-06-23 08:39:37 -05:00
• c25eb26c32 vulkan: support CONV_3D (llama/24612) Jeff Bolz 2026-06-23 08:39:20 -05:00