Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

talk.llama-coreml

threads

timing

try-fix-abort

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3419

#3422

#3422

#3423

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3934

#3934

#3936

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3946

#3947

#3948

#3948

#3950

#3956

#3956

#3957

#3957

#3959

#398

#404

#409

#41

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

Mono Color

• fc45bb8625 talk-llama : sync llama.cpp Georgi Gerganov 2025-08-18 19:32:04 +03:00
• 33c3c2fe2e sync : ggml Georgi Gerganov 2025-08-18 19:31:43 +03:00
• 5ed45b2518 ggml: Add initial WebGPU backend (llama/14521) Reese Levine 2025-08-18 19:22:37 +03:00
• 03d6607691 ggml : initial zDNN backend (llama/14975) Aaron Teo 2025-08-18 19:21:15 +03:00
• 7fd2fbde45 common : handle mxfp4 enum Georgi Gerganov 2025-08-18 18:57:45 +03:00
• 0fd4a250df ggml-quants : fix make_qp_quants NANs and IQ1 assertion errors (llama/15379) compilade 2025-08-18 03:23:56 -04:00
• fcd694ec1a vulkan: disable spirv-opt for bfloat16 shaders (llama/15352) Jeff Bolz 2025-08-18 00:56:29 -05:00
• 6835e0cf77 vulkan: Use larger workgroups for mul_mat_vec when M is small (llama/15355) Jeff Bolz 2025-08-17 11:08:57 -05:00
• c225f25907 vulkan: support sqrt (llama/15370) Dong Won Kim 2025-08-17 23:03:09 +09:00
• 0a8285186a vulkan: Optimize argsort (llama/15354) Jeff Bolz 2025-08-17 03:41:45 -05:00
• c44d449635 vulkan: fuse adds (llama/15252) Jeff Bolz 2025-08-16 11:48:22 -05:00
• d14e626e6a vulkan: Support mul_mat_id with f32 accumulators (llama/15337) Jeff Bolz 2025-08-16 04:18:31 -05:00
• 5b62995350 vulkan: Add missing bounds checking to scalar/coopmat1 mul_mat_id (llama/15334) Jeff Bolz 2025-08-16 03:58:38 -05:00
• e27f4f205d OpenCL: add initial FA support (llama/14987) rmatif 2025-08-16 10:05:55 +02:00
• 77771b2711 opencl: add initial mxfp4 support via mv (llama/15270) lhez 2025-08-16 00:52:14 +08:00
• 1e8d692365 vulkan : fix out-of-bounds access in argmax kernel (llama/15342) Georgi Gerganov 2025-08-15 17:16:36 +03:00
• 1a92fde1b6 vulkan : fix compile warnings on macos (llama/15340) Georgi Gerganov 2025-08-15 16:28:28 +03:00
• f797a6f9c8 ggml: initial IBM zDNN backend (llama/14975) Aaron Teo 2025-08-15 21:11:22 +08:00
• ba32f5df0a CUDA: fix negative KV_max values in FA (llama/15321) Johannes Gäßler 2025-08-14 23:21:24 +02:00
• 0e15332255 HIP: Cleanup hipification header (llama/15285) uvos 2025-08-14 16:23:56 +02:00
• 1d8b21caa0 vulkan: perf_logger improvements (llama/15246) Jeff Bolz 2025-08-14 08:38:10 -05:00
• 4a6cf896ad ggml: fix ggml_conv_1d_dw bug (ggml/1323) Jason Ni 2025-08-14 19:17:51 +08:00
• 367cd11f5d cuda : fix GGML_CUDA_GRAPHS=OFF (llama/15300) Sigbjørn Skjæret 2025-08-14 12:22:07 +02:00
• c76ec72d59 finetune: SGD optimizer, more CLI args (llama/13873) Jonathan Graehl 2025-08-14 03:03:57 -07:00
• cbaec6c4ac HIP: bump requirement to rocm 6.1 (llama/15296) uvos 2025-08-13 20:44:30 +02:00
• 80ef57f0f0 ggml : update ggml_rope_multi (llama/12665) Judd 2025-08-13 18:45:15 +08:00
• 0e8b244366 ggml : repack block_iq4_nlx8 (llama/14904) Georgi Gerganov 2025-08-13 11:09:39 +03:00
• b8b1b50c47 CUDA: Optimize reduce_rows_f32 kernel, leading up to 25x perf improvement on kernel-level and 10% perf increase for Gemma3n (llama/15132) Oliver Simons 2025-08-13 10:04:46 +02:00
• 4e234ac013 ggml-rpc: chunk send()/recv() to avoid EINVAL for very large tensors over RPC (macOS & others) (llama/15188) Tak-RS 2025-08-13 14:54:30 +09:00
• 8df931b608 HIP: disable sync warp shuffel operators from clr amd_warp_sync_functions.h (llama/15273) uvos 2025-08-12 22:15:12 +02:00
• 1334f434f3 sycl: Fix and disable more configurations of mul_mat (llama/15151) Romain Biessy 2025-08-12 13:58:22 +02:00
• 139110701e opencl: allow mixed f16/f32 add (llama/15140) rmatif 2025-08-12 11:42:41 +02:00
• 082c7ba67c CUDA cmake: add -lineinfo for easier debug (llama/15260) Aman Gupta 2025-08-12 17:21:45 +08:00
• 0effaad964 CANN: GGML_OP_CPY optimization (llama/15070) Chenguang Li 2025-08-12 16:12:13 +08:00
• 8e2ddfec31 musa: fix failures in test-backend-ops for mul_mat_id op (llama/15236) R0CKSTAR 2025-08-12 10:02:51 +08:00
• 3e2c262c08 CANN: Add broadcast for softmax and FA (llama/15208) hipudding 2025-08-11 22:50:31 +08:00
• 30cc11dc94 kleidiai: fix unsigned overflow bug (llama/15150) Charles Xu 2025-08-11 09:59:26 +02:00
• 457eadfe6f cuda: refactored ssm_scan and use CUB (llama/13291) David Zhao 2025-08-09 13:29:43 -05:00
• 93c7a08019 CUDA: add attention sinks for tile and wmma (llama/15178) Aman Gupta 2025-08-09 20:00:24 +08:00
• 62566a5436 gguf-py : add Numpy MXFP4 de/quantization support (llama/15111) compilade 2025-08-08 17:48:26 -04:00
• 573bf9d128 ggml : fix field name when new ggml_backend (llama/14944) AN Long 2025-08-08 21:37:22 +09:00
• 2baea5e4b3 CUDA: attention sinks for mma FlashAttention (llama/15157) Johannes Gäßler 2025-08-08 08:19:58 +02:00
• 8a36cd924a opencl: support sink in soft_max (attn sinks) (llama/15152) lhez 2025-08-08 13:47:03 +09:00
• 1984530710 vulkan: support fattn sinks (llama/15126) Jeff Bolz 2025-08-07 15:44:20 -05:00
• 414e9074e0 vulkan: Add env var to disable host visible vidmem (llama/15109) Jeff Bolz 2025-08-07 15:07:11 -05:00
• 813ceb2a74 HIP: add cmake option to enable compiler output of kernel resource usage metrics (llama/15103) uvos 2025-08-07 16:44:14 +02:00
• 6d7ffea292 ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (llama/15094) Christian Kastner 2025-08-07 13:45:41 +02:00
• 5caf8a1ea2 CUDA: GEMM for FP32/FP16/BF16 and ne11 <= 16 (llama/15131) Johannes Gäßler 2025-08-07 10:53:21 +02:00
• b405fd88b3 fix profiling crash (llama/15072) rmatif 2025-08-06 23:17:51 +02:00
• d153cfb507 opencl: add swiglu_oai and add_id (llama/15121) lhez 2025-08-07 04:12:17 +09:00
• 6fb55d8f7c ggml : fix fallback to CPU for ununsupported ops (llama/15118) Diego Devesa 2025-08-06 05:37:35 -07:00
• e809e81e69 CANN: add support for ACL Graph (llama/15065) Chenguang Li 2025-08-06 14:12:42 +08:00
• d3aab3efde llama : add gpt-oss (llama/15091) Georgi Gerganov 2025-08-05 22:10:36 +03:00
• 6558022873 sycl: fix mul_mat selection (llama/15092) Romain Biessy 2025-08-05 18:39:55 +02:00
• 349b9a2097 cmake: Add GGML_BACKEND_DIR option (llama/15074) Christian Kastner 2025-08-04 21:29:14 +02:00
• 00ff38376a vulkan: fix build when using glslang that does not support coopmat2 (llama/15062) Jeff Bolz 2025-08-04 00:09:19 -05:00
• abc971e69a vulkan: Use coopmat2 for conv2d (llama/14982) Jeff Bolz 2025-08-03 07:23:57 -05:00
• 53d8c5179f opencl: fix adreno compiler detection logic (llama/15029) lhez 2025-08-02 10:51:18 -07:00
• d6e7315717 CUDA: use mma FA kernel for gqa > 4 on RTX 4000 (llama/15035) Johannes Gäßler 2025-08-02 16:37:08 +02:00
• a3123e105b cuda: make im2col a little faster (llama/15025) leejet 2025-08-02 22:15:36 +08:00
• d119ecf0c1 cuda, sycl : fix batched gemm when ne02 == 1 && ne03 > 1 (llama/15038) Georgi Gerganov 2025-08-02 17:13:05 +03:00
• b374fd6172 vulkan: coopmat2 mul_mat optimizations (llama/14934) Jeff Bolz 2025-08-02 04:21:37 -05:00
• 97341224b2 vulkan: Support ne[3]>1 in noncontig matrix-vector multiply (llama/15015) Jeff Bolz 2025-08-02 03:48:30 -05:00
• 46e9e5b9a7 vulkan: optimizations for direct convolution (llama/14933) Jeff Bolz 2025-08-02 02:57:04 -05:00
• 7e7557ac50 CUDA: fix MMQ nwarps for AMD with warp_size==32 (llama/15014) Johannes Gäßler 2025-08-01 20:47:32 +02:00
• ba6a81c9c9 opencl: add f16 for add, sub, mul, div (llama/14984) lhez 2025-08-01 04:15:44 -07:00
• 1c6cb7df47 ggml : Q2k interleaving implementation - x86/x64 SIMD (llama/14373) Srihari-mcw 2025-08-01 11:50:33 +05:30
• 78668cb8d1 docker : add cann build pipline (llama/14591) diannao 2025-08-01 10:02:34 +08:00
• 41e161657e Vulkan: Fix minor debug mode issues (llama/14899) Ruben Ortlam 2025-07-31 17:46:54 +02:00
• 572152d6af CANN: Improve loading efficiency after converting weights to NZ format. (llama/14985) hipudding 2025-07-31 19:47:20 +08:00
• 4904bc3bda opencl: add mul_mat_f32_f32_l4_lm and mul_mat_f16_f32_l4_lm (llama/14809) lhez 2025-07-30 14:56:55 -07:00
• 8ed27b407d HIP: enable mfma mmq on gfx908 and gfx90a for select datatypes and shapes (llama/14949) uvos 2025-07-30 17:38:06 +02:00
• 113d88686b CUDA: skip masked KV slices for all FA kernels (llama/14924) Johannes Gäßler 2025-07-30 15:46:13 +02:00
• 4e624e42fa HIP: remove the use of __HIP_PLATFORM_AMD__, explicitly support only AMD targets (llama/14945) uvos 2025-07-29 20:23:04 +02:00
• 7f203f41aa HIP: add GGML_HIP_MMQ_MFMA option to allow disableing the MFMA path. (llama/14930) uvos 2025-07-29 17:44:30 +02:00
• a3899e78af HIP: Ignore unsupported unroll transformation in fattn-vec (llama/14931) uvos 2025-07-29 17:43:43 +02:00
• c42e55e054 CANN: Add ggml_set_rows (llama/14943) hipudding 2025-07-29 22:36:43 +08:00
• 682d659416 cuda : add softcap fusion (llama/14907) Sigbjørn Skjæret 2025-07-29 14:22:03 +02:00
• 577f47111e CUDA: add roll (llama/14919) Aman Gupta 2025-07-29 14:45:18 +08:00
• 4dca34a4de ggml-cpu : deduplicate scalar implementations (llama/14897) xctan 2025-07-28 23:40:24 +08:00
• 4908e9dd05 SYCL: Add set_rows support for quantized types (llama/14883) Akarshan Biswas 2025-07-28 20:32:15 +05:30
• 24d3524bfd CUDA: fix pointer incrementation in FA (llama/14916) Johannes Gäßler 2025-07-28 14:30:22 +02:00
• 923619ffd5 sycl: refactor quantization to q8_1 (llama/14815) Alberto Cabrera Pérez 2025-07-28 11:05:53 +01:00
• 45784c05ae cmake : Fix BLAS link interface (ggml/1316) Kai Pastor 2025-07-30 14:53:16 +02:00
• 01bdc522e0 vulkan : fix 32-bit builds (ggml/1313) Kai Pastor 2025-07-30 14:52:26 +02:00
• 9446500b9d scripts : update sync scripts Georgi Gerganov 2025-08-18 19:31:13 +03:00
• 040510a132 node : add win platform check for require path (#3363) Daniel Bevenius 2025-08-15 14:54:23 +02:00
• 16c2924cb2 ci : update main-cuda.Dockerfile (#3371) ustas 2025-08-13 14:30:45 -03:00
• 5527454cdb whisper : fixed crash in GPU device selection on multi-GPU systems (#3372) Dw9 2025-08-12 18:58:52 +08:00
• b02242d0ad wasm : change ggml model host to HF (#3369) Georgi Gerganov 2025-08-10 13:00:17 +03:00
• 4245c77b65 ruby : Add ruby binding for max_len (#3365) Adam Debono 2025-08-07 12:37:45 +10:00
• 0becabc8d6 stream.wasm : add language selection support (#3354) Daniel Bevenius 2025-08-02 07:03:04 +02:00
• f7502dca87 whisper : reset conv scheduler when CoreML is used (#3350) Georgi Gerganov 2025-07-30 21:54:58 +03:00
• 28b39c624e ggml : remove old kompute, cann (skip) (#3349) Georgi Gerganov 2025-07-30 16:08:57 +03:00
• d0a9d8c7f8 talk-llama : sync llama.cpp Georgi Gerganov 2025-07-28 10:09:47 +03:00
• 5b4646df1a sync : ggml Georgi Gerganov 2025-07-28 08:43:53 +03:00
• d96f4d8ea1 vulkan : add fp16 support for the conv_2d kernel (llama/14872) Erik Scholz 2025-07-27 12:04:33 +02:00
• 5693b857d2 vulkan: skip empty set_rows to avoid invalid API usage (llama/14860) Jeff Bolz 2025-07-27 04:05:34 -05:00
• b275e52b46 HIP: Enable Matrix cores for MMQ Kernels, Enable stream-K for CDNA 3 (llama/14624) deepsek 2025-07-26 18:28:14 -04:00
• 4692558a1f CANN: Implement GLU ops (llama/14884) hipudding 2025-07-26 17:56:18 +08:00