Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

talk.llama-coreml

threads

timing

try-fix-abort

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3419

#3422

#3422

#3423

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3934

#3934

#3936

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3946

#3947

#3948

#3948

#3950

#3950

#3956

#3956

#3957

#3957

#3959

#398

#404

#409

#41

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

Mono Color

• 5069c08034 ggml : split graph allocations according to backend max buffer size (llama/15815) Acly 2025-09-24 16:17:49 +02:00
• 41245891c1 ggml-cpu: Respect cpumask settings (llama/16164) Xiangyan Sun 2025-09-23 01:58:12 -07:00
• 73e8f3acb8 ggml : fix uninitialized is_on_grid in quantize_row_iq3_xxs_impl (llama/15928) Sigbjørn Skjæret 2025-09-23 10:25:20 +02:00
• c706a50746 zdnn: refactor codebase + add docs (llama/16178) Aaron Teo 2025-09-23 14:53:05 +08:00
• d8d31e3638 ggml-cpu : fix typo in gemm comments [no ci] (llama/16189) Daniel Bevenius 2025-09-23 05:59:03 +02:00
• 4e32ee733b ggml : implement set_rows with i32 index (llama/16159) Sigbjørn Skjæret 2025-09-22 19:13:00 +02:00
• df672c6372 ggml : extend ggml_can_fuse to work with non-sequential nodes (llama/16123) Georgi Gerganov 2025-09-22 11:12:37 +03:00
• 973054a8cd ggml : add ggml_op_is_empty (llama/16122) Georgi Gerganov 2025-09-22 11:12:09 +03:00
• 9f673df08d Vulkan: add conv_transpose_2d operation (llama/16022) Shin-myoung-serp 2025-09-22 17:04:01 +09:00
• 14723f25a1 vulkan: add RTE variants of exp shader (llama/16165) Jeff Bolz 2025-09-22 00:37:17 -05:00
• 95b29fab78 vulkan: vec dot matrix multiplication fix (llama/16151) Ruben Ortlam 2025-09-22 07:22:43 +02:00
• 4b7f09ac0b opencl: fix concat crash on win arm64 with Adreno (llama/15944) lhez 2025-09-21 16:42:10 -07:00
• 0a7096f4f3 opencl: initial q8_0 mv support (llama/15732) lhez 2025-09-21 14:48:44 -07:00
• eae2be0ca2 vulkan: optimize UMA buffer operations and fix driver hangs (llama/16059) Giuseppe Scrivano 2025-09-21 08:31:55 +02:00
• 9a6c2036a9 vulkan: fix validation error about VK_PIPELINE_CREATE_CAPTURE_STATISTICS_BIT_KHR (llama/16086) Jeff Bolz 2025-09-21 01:23:37 -05:00
• 8d10ded025 ggml : prepare for development of 0.9.2-dev Georgi Gerganov 2025-09-20 16:44:23 +03:00
• d89164a08d ggml : bump version to 0.9.1 Georgi Gerganov 2025-09-20 16:44:23 +03:00
• 36778bd8b8 talk-llama : sync llama.cpp Georgi Gerganov 2025-09-20 13:47:47 +03:00
• 66ad624d5b sync : ggml Georgi Gerganov 2025-09-20 13:46:41 +03:00
• 76d0934287 vulkan: use vec dot for matrix matrix multiplications (llama/16056) Ruben Ortlam 2025-09-20 10:42:56 +02:00
• 2ad00d5586 ggml : refactor forward_dup for cpu backend (llama/16062) Xuan-Son Nguyen 2025-09-19 11:31:56 +07:00
• 4d8cd07825 ggml-amx : fix ggml_amx_init() on generic Linux (llama/16049) Adrien Gallouët 2025-09-18 23:07:26 +02:00
• 4575f96873 cmake : fix static linking for OpenMP on Unix-like systems (llama/16031) Adrien Gallouët 2025-09-18 23:07:18 +02:00
• f4a225cea6 opencl: optimize mxfp4 kernels (llama/16037) Shawn Gu 2025-09-18 12:03:34 -07:00
• 7fcb7e83ec rename optimize_graph to graph_optimize (llama/16082) Jeff Bolz 2025-09-18 13:46:17 -05:00
• fce6354e0f CUDA: Optimize PAD_REFLECT_1D (llama/15957) Bowen Han 2025-09-18 11:26:03 -07:00
• 05bdfd4380 CUDA: fix compilation on CC 6.0 (llama/16091) Johannes Gäßler 2025-09-18 19:28:32 +02:00
• 960aaa9904 metal : use function constants for mul_mv_ext kernels (llama/16074) Georgi Gerganov 2025-09-18 16:28:41 +03:00
• 225d7c1d5a cuda : add missing F32<->I32 entries in ggml_cuda_cpy_fn (llama/16060) Sigbjørn Skjæret 2025-09-18 13:28:22 +02:00
• d37f590a77 metal : improve F32, F16 and BF16 mat-vec multiplication (llama/16057) Georgi Gerganov 2025-09-18 12:33:45 +03:00
• 32b6d9c134 metal : avoid call free for non-owned buffer (llama/16067) Jhen-Jie Hong 2025-09-18 15:06:48 +08:00
• 1f24b1df4d metal : handle nil cv during pipeline creation (llama/16065) Georgi Gerganov 2025-09-18 10:03:24 +03:00
• c46adc0817 CANN: Remove print (llama/16044) Chenguang Li 2025-09-18 09:26:33 +08:00
• 1361f679cc GGML WebGPU: Support for ADD, MUL, RMS_NORM, GET_ROWS operators (llama/16018) Reese Levine 2025-09-17 13:09:40 -07:00
• eb2c01f92e metal : refactor + optimize v2 (llama/15995) Georgi Gerganov 2025-09-20 13:46:10 +03:00
• 6458bac4c1 sync : ggml Georgi Gerganov 2025-09-20 13:45:32 +03:00
• d452f0cf8c CUDA: fix FA occupancy, optimize tile kernel (llama/15982) Johannes Gäßler 2025-09-17 15:32:42 +02:00
• e96b285011 vulkan: automatically remove unsupported devices (llama/15976) Eve 2025-09-17 07:35:37 +00:00
• e32c3b0fd3 CANN: Optimize ggml_cann_set_device (llama/15935) Chenguang Li 2025-09-17 14:33:08 +08:00
• 5c524bb879 ggml : fix padding in timestep embedding kernels (llama/15932) Daniel Bevenius 2025-09-16 15:25:57 +02:00
• f72ec185fb CUDA: fix im2col_3d to respect non-contiguous inputs (views) (llama/15956) Jake Karnes 2025-09-15 16:28:31 -06:00
• a642b533a4 SYCL: Add COUNT_EQUAL operator support (llama/15991) yael-works 2025-09-15 19:51:35 +03:00
• 10bd5d3626 CUDA: some micro-optimizations in mmf.cuh for mul_mat_id (llama/15926) Aman Gupta 2025-09-15 17:35:11 +08:00
• 82a8c141ea metal : remove memory pools (llama/15966) Georgi Gerganov 2025-09-14 22:02:32 +03:00
• c36358cb3c Vulkan: Clean up mul_mm shader (llama/15987) Ruben Ortlam 2025-09-14 16:56:28 +02:00
• 2d3f15607f metal : fix kernel requirements (llama/15983) Georgi Gerganov 2025-09-14 15:33:22 +03:00
• 7dca05ca77 ggml-zdnn: rm user mapped buffers (llama/15965) Aaron Teo 2025-09-14 13:37:03 +08:00
• 1789ed3f2c vulkan: fix failing dequant shaders (llama/15862) Jeff Bolz 2025-09-13 16:29:43 +01:00
• a3defb0a3b vulkan: initialize vulkan-hpp to allow using extension function pointers (llama/15705) Jeff Bolz 2025-09-13 16:23:30 +01:00
• 2caf15d68a metal : refactor kernel loading (llama/15964) Georgi Gerganov 2025-09-13 16:24:22 +03:00
• 0d36ba9e1a metal : allow ops to run concurrently (llama/15929) Georgi Gerganov 2025-09-13 13:54:28 +03:00
• 20a930ec94 metal : fix memory leaks (llama/15962) Georgi Gerganov 2025-09-13 12:45:04 +03:00
• e902731ccc ggml-zdnn: fix #15414, activate FP16 and BF16 acceleration and incorrect zTensor free (llama/15839) Aaron Teo 2025-09-13 02:39:52 +08:00
• 424c85f22a Vulkan iGPU device selection overhaul and PCI ID API support (llama/15947) Ruben Ortlam 2025-09-12 13:24:21 +02:00
• 5a752bab84 vulkan: Make device memory check more portable (llama/15939) Mathieu Baudier 2025-09-12 09:06:20 +02:00
• cd764eaf2b Revert "sycl: add usage of enqueue_functions extension (llama/14244)" (llama/15910) Neo Zhang Jianyu 2025-09-12 09:15:12 +08:00
• 555dcb3e01 ggml-backend : add GGML_BACKEND_DEVICE_TYPE_IGPU device type (llama/15797) Diego Devesa 2025-09-11 13:47:38 -07:00
• f0768eb575 CUDA: larger SRAM reads for tile FA, AMD FP16 dot (llama/15927) Johannes Gäßler 2025-09-11 21:19:58 +02:00
• 020eb19eb3 ggml-cpu : add check for ARM MATMUL_INT8/i8mm support (llama/15922) Daniel Bevenius 2025-09-11 15:39:12 +02:00
• b079d9c8b0 kleidiai: fix GGML_ASSERT(*cur_backend_id != -1) failed (llama/15614) Charles Xu 2025-09-11 12:45:40 +02:00
• dadf73665a CANN: Disable acl_graph for prefill stage (llama/15933) hipudding 2025-09-11 15:59:37 +08:00
• f5ef0e25e2 CUDA: Add fastdiv to k_bin_bcast*, giving 1-3% E2E performance (llama/15872) Oliver Simons 2025-09-10 22:04:03 +02:00
• 3617008c37 ggml-cpu : fix padding in ggml_timestep_embedding (llama/15917) Daniel Bevenius 2025-09-10 17:31:40 +02:00
• c974f63057 sync : ggml Georgi Gerganov 2025-09-20 13:44:48 +03:00
• 7eae055e61 metal : make the backend async (llama/15906) Georgi Gerganov 2025-09-20 13:44:27 +03:00
• e2c7f1cccd sync : ggml Georgi Gerganov 2025-09-20 13:43:01 +03:00
• 4d453b14a9 CANN: Add ROPE sin/cos cache for reuse (llama/15912) Chenguang Li 2025-09-10 18:42:00 +08:00
• 9b773acac0 CANN: implement LRU cache for ACL graphs (llama/15814) Chenguang Li 2025-09-10 15:29:12 +08:00
• 7abe187860 vulkan: throw the oom error instead of no memory type found (llama/15905) Ruben Ortlam 2025-09-09 22:26:03 +02:00
• d0e98656c3 vulkan: Fix OOB accesses in soft_max_back (llama/15861) Jeff Bolz 2025-09-09 07:41:15 -05:00
• e35d1375ee HIP: use v_dot2_f32_f16 instruction for FA (llama/15884) Johannes Gäßler 2025-09-09 14:04:43 +02:00
• 7fbbb67b47 Workaround for subgroup arithmetic failing on MoltenVK with AMD GPUs (issue 15846) (llama/15886) lksj92hs 2025-09-09 15:01:15 +03:00
• 621764b1a5 CUDA: Add mul_mat_id support for the mmf kernel (llama/15767) Aman Gupta 2025-09-09 14:38:02 +08:00
• 260982232c CUDA: fix GET_ROWS for large tensors (llama/15882) Johannes Gäßler 2025-09-09 08:11:01 +02:00
• c29cd54818 vulkan: sort graph to allow more parallel execution (llama/15850) Jeff Bolz 2025-09-08 13:10:07 -05:00
• 70ee808f3d CUDA: generate_cu_files.py - add missing mxfp4 (llama/15880) Aman Gupta 2025-09-09 01:23:46 +08:00
• ae6cc6a386 cuda : fix supports_op condition for get_rows when number of blocks is too large (llama/15868) Georgi Gerganov 2025-09-08 13:56:51 +03:00
• e9cb59e970 metal : refactor + optimize (llama/15857) Georgi Gerganov 2025-09-20 13:04:02 +03:00
• 40bcd1a469 ggml: allow casting between f32 and i32 (llama/15783) Xuan-Son Nguyen 2025-09-08 17:33:01 +07:00
• 0175a1df8d CUDA: non-contiguous src0 not supported for PAD (llama/15869) Sigbjørn Skjæret 2025-09-08 11:55:44 +02:00
• d9c0ead2ab CANN: Stream sync between devices for acl_graph (llama/15809) Chenguang Li 2025-09-08 10:03:29 +08:00
• dfa7722e2e vulkan: support im2col_3d (llama/15795) Jeff Bolz 2025-09-07 13:50:26 -05:00
• db4f504b69 ggml-cpu: clean up s390x SIMD (llama/15855) Aaron Teo 2025-09-08 02:18:28 +08:00
• 9523fd8de6 vulkan: Support pad_ext (llama/15794) Jeff Bolz 2025-09-07 12:00:49 -05:00
• 647e2d7de5 vulkan: Use larger loads in scalar/coopmat1 matmul (llama/15729) Jeff Bolz 2025-09-07 11:53:07 -05:00
• cda7d4e5ac ggml WebGPU: remove userdata from request adapter callback (llama/15527) Daniel Bevenius 2025-09-07 10:19:45 +02:00
• cd70d89628 CUDA: faster tile FA (Pascal/AMD), headsize 256 (llama/15769) Johannes Gäßler 2025-09-07 00:26:28 +02:00
• be2676bb1c kleidiai: generalize compute_forward_kv_cache to compute_forward_fp16 (llama/15817) Charles Xu 2025-09-06 16:08:43 +02:00
• 69400f16f1 ggml-cpu: document use of "free" memory [no ci] (llama/15834) Johannes Gäßler 2025-09-06 13:28:44 +02:00
• f499271c4e ggml-cpu: drop support for nnpa intrinsics (llama/15821) Aaron Teo 2025-09-06 11:27:28 +08:00
• 6ff468cfaa CUDA: fastdiv, launch bounds for mmvq + q8_1 quant (llama/15802) Johannes Gäßler 2025-09-05 16:07:02 +02:00
• 4d6e1144b1 ggml : introduce semantic versioning (ggml/1336) Daniel Bevenius 2025-09-16 06:16:52 +02:00
• c80f78cc7b CUDA : conditionally add cuda architectures (ggml/1341) Gregor Jasny 2025-09-10 17:21:11 +02:00
• ffe560cbb1 metal : Add template specialization for mul_mm_id w/ ne20 == 10 (llama/15799) Gabe Goodhart 2025-09-04 09:53:22 -06:00
• 3780a3c917 CANN: Refactor ND to NZ workspace to be per-device (llama/15763) Chenguang Li 2025-09-04 20:20:14 +08:00
• 2228462b19 ggml: add ops for WAN video model (cuda && cpu) (llama/15669) leejet 2025-09-04 16:38:49 +08:00
• 96efb472b4 CANN: Fix precision issue on 310I DUO multi-devices (llama/15784) hipudding 2025-09-04 15:12:30 +08:00
• 1569daf524 opencl: add hs=40 to FA (llama/15758) rmatif 2025-09-04 08:30:28 +02:00
• 5c860e94c6 CANN: fix acl_rstd allocation size in ggml_cann_rms_norm (llama/15760) Chenguang Li 2025-09-04 11:03:02 +08:00
• 719a05c665 vulkan: fix mmv subgroup16 selection (llama/15775) Ruben Ortlam 2025-09-03 22:55:10 +02:00