Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

sync-ggml-26-07-30

talk.llama-coreml

threads

timing

try-fix-abort

whisper-rc-v1.9.4

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3422

#3422

#3423

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3934

#3934

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3947

#3948

#3948

#3950

#3956

#3957

#3959

#3962

#3963

#3964

#3964

#3966

#3969

#3970

#3972

#3975

#3976

#3976

#3977

#3979

#398

#3980

#3980

#3981

#3982

#3985

#3987

#3987

#3989

#3990

#3991

#3994

#3996

#3997

#3998

#3999

#4000

#4001

#4002

#4003

#4004

#4005

#4006

#4007

#4008

#4009

#4010

#4012

#4013

#4015

#4016

#4017

#4019

#4020

#4020

#4021

#4021

#4022

#4023

#4023

#4025

#4028

#4028

#4029

#4029

#4031

#4032

#4033

#4033

#4034

#4035

#4038

#404

#4040

#4044

#4045

#4047

#4048

#4049

#4049

#4050

#4051

#4052

#4053

#4054

#4054

#4055

#4055

#4056

#4057

#4058

#4060

#4061

#4064

#4065

#4066

#4066

#4068

#4068

#4069

#4070

#4072

#4073

#4074

#4077

#4079

#4080

#4082

#4083

#4086

#4086

#4087

#4087

#4089

#4089

#409

#4091

#4091

#4095

#4095

#41

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

b4938

b5127

b5130

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

v1.9.2

v1.9.3

v1.9.4

Mono Color

• c76ec72d59 finetune: SGD optimizer, more CLI args (llama/13873) 3 people 2025-08-14 03:03:57 -07:00
• cbaec6c4ac HIP: bump requirement to rocm 6.1 (llama/15296) uvos 2025-08-13 20:44:30 +02:00
• 80ef57f0f0 ggml : update ggml_rope_multi (llama/12665) JuddandGeorgi Gerganov 2025-08-13 18:45:15 +08:00
• 0e8b244366 ggml : repack block_iq4_nlx8 (llama/14904) Georgi Gerganov 2025-08-13 11:09:39 +03:00
• b8b1b50c47 CUDA: Optimize reduce_rows_f32 kernel, leading up to 25x perf improvement on kernel-level and 10% perf increase for Gemma3n (llama/15132) Oliver Simons 2025-08-13 10:04:46 +02:00
• 4e234ac013 ggml-rpc: chunk send()/recv() to avoid EINVAL for very large tensors over RPC (macOS & others) (llama/15188) Tak-RSandShinnosuke Takagi 2025-08-13 14:54:30 +09:00
• 8df931b608 HIP: disable sync warp shuffel operators from clr amd_warp_sync_functions.h (llama/15273) uvos 2025-08-12 22:15:12 +02:00
• 1334f434f3 sycl: Fix and disable more configurations of mul_mat (llama/15151) Romain Biessy 2025-08-12 13:58:22 +02:00
• 139110701e opencl: allow mixed f16/f32 add (llama/15140) rmatif 2025-08-12 11:42:41 +02:00
• 082c7ba67c CUDA cmake: add -lineinfo for easier debug (llama/15260) Aman Gupta 2025-08-12 17:21:45 +08:00
• 0effaad964 CANN: GGML_OP_CPY optimization (llama/15070) Chenguang Li 2025-08-12 16:12:13 +08:00
• 8e2ddfec31 musa: fix failures in test-backend-ops for mul_mat_id op (llama/15236) R0CKSTAR 2025-08-12 10:02:51 +08:00
• 3e2c262c08 CANN: Add broadcast for softmax and FA (llama/15208) hipudding 2025-08-11 22:50:31 +08:00
• 30cc11dc94 kleidiai: fix unsigned overflow bug (llama/15150) Charles Xu 2025-08-11 09:59:26 +02:00
• 457eadfe6f cuda: refactored ssm_scan and use CUB (llama/13291) David Zhao 2025-08-09 13:29:43 -05:00
• 93c7a08019 CUDA: add attention sinks for tile and wmma (llama/15178) Aman Gupta 2025-08-09 20:00:24 +08:00
• 62566a5436 gguf-py : add Numpy MXFP4 de/quantization support (llama/15111) compilade 2025-08-08 17:48:26 -04:00
• 573bf9d128 ggml : fix field name when new ggml_backend (llama/14944) AN Long 2025-08-08 21:37:22 +09:00
• 2baea5e4b3 CUDA: attention sinks for mma FlashAttention (llama/15157) Johannes Gäßler 2025-08-08 08:19:58 +02:00
• 8a36cd924a opencl: support sink in soft_max (attn sinks) (llama/15152) lhez 2025-08-08 13:47:03 +09:00
• 1984530710 vulkan: support fattn sinks (llama/15126) Jeff Bolz 2025-08-07 15:44:20 -05:00
• 414e9074e0 vulkan: Add env var to disable host visible vidmem (llama/15109) Jeff Bolz 2025-08-07 15:07:11 -05:00
• 813ceb2a74 HIP: add cmake option to enable compiler output of kernel resource usage metrics (llama/15103) uvos 2025-08-07 16:44:14 +02:00
• 6d7ffea292 ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (llama/15094) Christian Kastner 2025-08-07 13:45:41 +02:00
• 5caf8a1ea2 CUDA: GEMM for FP32/FP16/BF16 and ne11 <= 16 (llama/15131) Johannes Gäßler 2025-08-07 10:53:21 +02:00
• b405fd88b3 fix profiling crash (llama/15072) rmatif 2025-08-06 23:17:51 +02:00
• d153cfb507 opencl: add swiglu_oai and add_id (llama/15121) lhez 2025-08-07 04:12:17 +09:00
• 6fb55d8f7c ggml : fix fallback to CPU for ununsupported ops (llama/15118) Diego Devesa 2025-08-06 05:37:35 -07:00
• e809e81e69 CANN: add support for ACL Graph (llama/15065) Chenguang Li 2025-08-06 14:12:42 +08:00
• d3aab3efde llama : add gpt-oss (llama/15091) 3 people 2025-08-05 22:10:36 +03:00
• 6558022873 sycl: fix mul_mat selection (llama/15092) Romain Biessy 2025-08-05 18:39:55 +02:00
• 349b9a2097 cmake: Add GGML_BACKEND_DIR option (llama/15074) Christian Kastner 2025-08-04 21:29:14 +02:00
• 00ff38376a vulkan: fix build when using glslang that does not support coopmat2 (llama/15062) Jeff Bolz 2025-08-04 00:09:19 -05:00
• abc971e69a vulkan: Use coopmat2 for conv2d (llama/14982) Jeff Bolz 2025-08-03 07:23:57 -05:00
• 53d8c5179f opencl: fix adreno compiler detection logic (llama/15029) lhez 2025-08-02 10:51:18 -07:00
• d6e7315717 CUDA: use mma FA kernel for gqa > 4 on RTX 4000 (llama/15035) Johannes Gäßler 2025-08-02 16:37:08 +02:00
• a3123e105b cuda: make im2col a little faster (llama/15025) leejet 2025-08-02 22:15:36 +08:00
• d119ecf0c1 cuda, sycl : fix batched gemm when ne02 == 1 && ne03 > 1 (llama/15038) Georgi Gerganov 2025-08-02 17:13:05 +03:00
• b374fd6172 vulkan: coopmat2 mul_mat optimizations (llama/14934) Jeff Bolz 2025-08-02 04:21:37 -05:00
• 97341224b2 vulkan: Support ne[3]>1 in noncontig matrix-vector multiply (llama/15015) Jeff Bolz 2025-08-02 03:48:30 -05:00
• 46e9e5b9a7 vulkan: optimizations for direct convolution (llama/14933) Jeff Bolzand0cc4m 2025-08-02 02:57:04 -05:00
• 7e7557ac50 CUDA: fix MMQ nwarps for AMD with warp_size==32 (llama/15014) Johannes Gäßler 2025-08-01 20:47:32 +02:00
• ba6a81c9c9 opencl: add f16 for add, sub, mul, div (llama/14984) lhez 2025-08-01 04:15:44 -07:00
• 1c6cb7df47 ggml : Q2k interleaving implementation - x86/x64 SIMD (llama/14373) Srihari-mcwandManogna-Sree 2025-08-01 11:50:33 +05:30
• 78668cb8d1 docker : add cann build pipline (llama/14591) 3 people 2025-08-01 10:02:34 +08:00
• 41e161657e Vulkan: Fix minor debug mode issues (llama/14899) Ruben Ortlam 2025-07-31 17:46:54 +02:00
• 572152d6af CANN: Improve loading efficiency after converting weights to NZ format. (llama/14985) hipudding 2025-07-31 19:47:20 +08:00
• 4904bc3bda opencl: add mul_mat_f32_f32_l4_lm and mul_mat_f16_f32_l4_lm (llama/14809) lhez 2025-07-30 14:56:55 -07:00
• 8ed27b407d HIP: enable mfma mmq on gfx908 and gfx90a for select datatypes and shapes (llama/14949) uvos 2025-07-30 17:38:06 +02:00
• 113d88686b CUDA: skip masked KV slices for all FA kernels (llama/14924) Johannes Gäßler 2025-07-30 15:46:13 +02:00
• 4e624e42fa HIP: remove the use of __HIP_PLATFORM_AMD__, explicitly support only AMD targets (llama/14945) uvos 2025-07-29 20:23:04 +02:00
• 7f203f41aa HIP: add GGML_HIP_MMQ_MFMA option to allow disableing the MFMA path. (llama/14930) uvos 2025-07-29 17:44:30 +02:00
• a3899e78af HIP: Ignore unsupported unroll transformation in fattn-vec (llama/14931) uvos 2025-07-29 17:43:43 +02:00
• c42e55e054 CANN: Add ggml_set_rows (llama/14943) hipudding 2025-07-29 22:36:43 +08:00
• 682d659416 cuda : add softcap fusion (llama/14907) Sigbjørn Skjæret 2025-07-29 14:22:03 +02:00
• 577f47111e CUDA: add roll (llama/14919) Aman Gupta 2025-07-29 14:45:18 +08:00
• 4dca34a4de ggml-cpu : deduplicate scalar implementations (llama/14897) xctan 2025-07-28 23:40:24 +08:00
• 4908e9dd05 SYCL: Add set_rows support for quantized types (llama/14883) Akarshan Biswas 2025-07-28 20:32:15 +05:30
• 24d3524bfd CUDA: fix pointer incrementation in FA (llama/14916) Johannes Gäßler 2025-07-28 14:30:22 +02:00
• 923619ffd5 sycl: refactor quantization to q8_1 (llama/14815) Alberto Cabrera Pérez 2025-07-28 11:05:53 +01:00
• 45784c05ae cmake : Fix BLAS link interface (ggml/1316) Kai Pastor 2025-07-30 14:53:16 +02:00
• 01bdc522e0 vulkan : fix 32-bit builds (ggml/1313) Kai Pastor 2025-07-30 14:52:26 +02:00
• 9446500b9d scripts : update sync scripts Georgi Gerganov 2025-08-18 19:31:13 +03:00
• 040510a132 node : add win platform check for require path (#3363) Daniel Bevenius 2025-08-15 14:54:23 +02:00
• 16c2924cb2 ci : update main-cuda.Dockerfile (#3371) ustas 2025-08-13 14:30:45 -03:00
• 5527454cdb whisper : fixed crash in GPU device selection on multi-GPU systems (#3372) Dw9 2025-08-12 18:58:52 +08:00
• b02242d0ad wasm : change ggml model host to HF (#3369) Georgi Gerganov 2025-08-10 13:00:17 +03:00
• 4245c77b65 ruby : Add ruby binding for max_len (#3365) Adam Debono 2025-08-07 12:37:45 +10:00
• 0becabc8d6 stream.wasm : add language selection support (#3354) Daniel Bevenius 2025-08-02 07:03:04 +02:00
• f7502dca87 whisper : reset conv scheduler when CoreML is used (#3350) Georgi Gerganov 2025-07-30 21:54:58 +03:00
• 28b39c624e ggml : remove old kompute, cann (skip) (#3349) Georgi Gerganov 2025-07-30 16:08:57 +03:00
• d0a9d8c7f8 talk-llama : sync llama.cpp Georgi Gerganov 2025-07-28 10:09:47 +03:00
• 5b4646df1a sync : ggml Georgi Gerganov 2025-07-28 08:43:53 +03:00
• d96f4d8ea1 vulkan : add fp16 support for the conv_2d kernel (llama/14872) Erik Scholz 2025-07-27 12:04:33 +02:00
• 5693b857d2 vulkan: skip empty set_rows to avoid invalid API usage (llama/14860) Jeff Bolz 2025-07-27 04:05:34 -05:00
• b275e52b46 HIP: Enable Matrix cores for MMQ Kernels, Enable stream-K for CDNA 3 (llama/14624) deepsek 2025-07-26 18:28:14 -04:00
• 4692558a1f CANN: Implement GLU ops (llama/14884) hipudding 2025-07-26 17:56:18 +08:00
• 8643960acc musa: fix build warnings (unused variable) (llama/14869) R0CKSTAR 2025-07-26 10:36:02 +08:00
• 6629201471 ggml-cpu : disable GGML_NNPA by default due to instability (llama/14880) Aaron Teo 2025-07-26 01:09:03 +08:00
• 0b0de0bbf2 metal: SSM_SCAN performance (llama/14743) Gabe GoodhartandGeorgi Gerganov 2025-07-25 10:47:39 -06:00
• d414c3f6ac opencl: add fused rms_norm_mul (llama/14841) lhez 2025-07-25 08:12:13 -07:00
• bbf2389919 ggml : remove invalid portPos specifiers from dot files (llama/14838) Oliver Simons 2025-07-25 13:29:57 +02:00
• 56350ecc12 rpc : check for null buffers in get/set/copy tensor endpoints (llama/14868) Chris Rohlf 2025-07-25 06:17:02 -04:00
• 270fa9b25c sched : fix multiple evaluations of the same graph with pipeline parallelism (llama/14855) Diego Devesa 2025-07-25 01:07:26 -07:00
• 89ae789450 musa: upgrade musa sdk to rc4.2.0 (llama/14498) R0CKSTAR 2025-07-25 03:05:37 +08:00
• 5823eabc78 cmake : Indent ggml-config.cmake (ggml/1310) Kai Pastor 2025-07-24 19:58:02 +02:00
• 7dc5ae2d6a sycl: fixed semantics of block offset calculation (llama/14814) Alberto Cabrera Pérez 2025-07-24 11:09:57 +01:00
• faedce5dcb metal : fix fusion across different encoders (llama/14849) Georgi Gerganov 2025-07-24 10:24:05 +03:00
• e648f9f079 sycl: fix undefined variable in work group size check (llama/14843) Donghyeon Jeong 2025-07-24 13:50:41 +09:00
• 95efcf011d CUDA: fix overflow in FA, tune performance (llama/14840) Johannes Gäßler 2025-07-23 21:43:25 +02:00
• 8272aa9f14 CUDA: fix compilation with GGML_CUDA_F16 (llama/14837) Johannes Gäßler 2025-07-23 18:22:30 +02:00
• a65976fc3c CUDA: fix quantized KV cache + multiple sequences (llama/14822) Johannes GäßlerandGeorgi Gerganov 2025-07-23 12:35:53 +02:00
• 026d8a0c6e ggml: fix loongarch quantize_row_q8_1 error (llama/14827) lixing-star 2025-07-23 14:39:51 +08:00
• 49d5540206 CANN: weight format to NZ for Ascend310P3 (llama/14407) chen fan 2025-07-23 11:58:00 +08:00
• f8402d0a95 CUDA: add fused rms norm (llama/14800) Aman Gupta 2025-07-23 09:25:42 +08:00
• c91361379a vulkan: fix rms_norm_mul to handle broadcasting dim0 (llama/14817) Jeff Bolz 2025-07-22 10:35:21 -05:00
• 810018a63a cuda : implement bf16 cpy ops and enable bf16 cont (llama/14763) Sigbjørn Skjæret 2025-07-22 12:33:10 +02:00
• de49384ab3 opencl: remove unreachable return (llama/14806) lhez 2025-07-21 23:53:30 -07:00
• 9008410087 cuda: remove linking to cublasLt (llama/14790) R0CKSTAR 2025-07-22 07:45:26 +08:00
• e81e17b048 opencl: fix im2col when KW!=KH (llama/14803) Sigbjørn Skjæret 2025-07-21 22:55:10 +02:00