Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

sync-ggml-26-07-30

talk.llama-coreml

threads

timing

try-fix-abort

whisper-rc-v1.9.4

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3422

#3422

#3423

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3934

#3934

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3947

#3948

#3948

#3950

#3956

#3957

#3959

#3962

#3963

#3964

#3964

#3966

#3969

#3970

#3972

#3975

#3976

#3976

#3977

#3979

#398

#3980

#3980

#3981

#3982

#3985

#3987

#3987

#3989

#3990

#3991

#3994

#3996

#3997

#3998

#3999

#4000

#4001

#4002

#4003

#4004

#4005

#4006

#4007

#4008

#4009

#4010

#4012

#4013

#4015

#4016

#4017

#4019

#4020

#4020

#4021

#4021

#4022

#4023

#4023

#4025

#4028

#4028

#4029

#4031

#4032

#4033

#4033

#4034

#4035

#4038

#404

#4040

#4044

#4045

#4047

#4048

#4049

#4049

#4050

#4051

#4052

#4053

#4054

#4054

#4055

#4055

#4056

#4057

#4058

#4060

#4061

#4064

#4065

#4066

#4066

#4068

#4068

#4069

#4070

#4072

#4073

#4074

#4077

#4079

#4080

#4082

#4083

#4086

#4086

#4087

#4087

#4089

#4089

#409

#4091

#4095

#4095

#4096

#4096

#4097

#4097

#41

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

b4938

b5127

b5130

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

v1.9.2

v1.9.3

v1.9.4

Mono Color

• b1385e9aa9 CUDA: correct the lowest Maxwell supported by CUDA 12 (llama/11984) PureJourneyandJohannes Gäßler 2025-02-21 19:21:05 +08:00
• 48f5e893f5 MUSA: support ARM64 and enable dp4a .etc (llama/11843) BodhiandBodhi Hu 2025-02-21 15:46:23 +08:00
• dc21871fcb ggml-cpu: Add CPU backend support for KleidiAI library (llama/11390) Charles Xu 2025-02-20 14:06:51 +01:00
• 64a430bc81 ggml: aarch64: implement SVE kernels for q3_K_q8_K vector dot (llama/11917) 3 people 2025-02-20 15:38:32 +05:30
• 51a3580c79 CUDA: use async data loading for FlashAttention (llama/11894) Johannes GäßlerandDiego Devesa 2025-02-17 14:03:24 +01:00
• 37a21dd43d vulkan: implement several ops relevant for ggml_opt (llama/11769) Rémy O 2025-02-17 07:55:57 +01:00
• 8a22a8b17f vulkan: support multi/vision rope, and noncontiguous rope (llama/11902) Jeff Bolz 2025-02-16 01:52:23 -06:00
• fcbcad0c90 metal : fix the crash caused by the lack of residency set support on Intel Macs. (llama/11904) Hale Chan 2025-02-16 14:50:26 +08:00
• 4444db7360 metal : optimize dequant q6_K kernel (llama/11892) Adrian Kretz 2025-02-15 19:39:20 +01:00
• a7fc1038ca repo : update links to new url (llama/11886) Georgi Gerganov 2025-02-15 16:40:57 +02:00
• 1689aaf854 vulkan: initial support for IQ1_S and IQ1_M quantizations (llama/11528) Rémy O 2025-02-15 09:01:40 +01:00
• 4b48fe449a opencl: Fix rope and softmax (llama/11833) lhez 2025-02-14 11:12:23 -08:00
• 47cc043e69 cuda : add ampere to the list of default architectures (llama/11870) Diego Devesa 2025-02-14 15:33:52 +01:00
• e3d9ffb98b ggml: optimize some vec dot functions for LoongArch ASX (llama/11842) Jinyang He 2025-02-14 16:54:27 +08:00
• e22d69839d vulkan: linux builds + small subgroup size fixes (llama/11767) Eve 2025-02-14 02:59:40 +00:00
• defe731263 llamafile: use member variable instead of constant for iq4nlt (llama/11780) Jeffrey Morgan 2025-02-13 09:05:04 -08:00
• 4e07957bf9 musa: bump MUSA SDK version to rc3.1.1 (llama/11822) R0CKSTAR 2025-02-13 20:28:18 +08:00
• d2c5154bb5 ggml-cpu : add chunking support to mul_mat_id (llama/11666) Diego Devesa 2025-02-13 01:02:38 +01:00
• 4fac43fe00 ggml : x2 speed for WASM by optimizing SIMD (llama/11453) Xuan-Son Nguyenandcamel-cdr 2025-02-13 00:33:45 +01:00
• 3be9670f17 HIP: Remove GCN from list of devices that avoid MMQ (llama/11831) uvos 2025-02-12 22:25:28 +01:00
• 86729fcd6d HIP: Switch to std::vector in rocblas version check (llama/11820) uvos 2025-02-12 17:25:03 +01:00
• 7fbca6304e cleanup: fix compile warnings associated with gnu_printf (llama/11811) bandoti 2025-02-12 10:06:53 -04:00
• d597f83e1a ggml : fix multi-threaded clamp_f32 (llama/11824) Richard 2025-02-12 13:57:33 +00:00
• e5edcc6259 ggml-cpu: Fix duplicate MATMUL_INT8 (llama/11817) Weizhao Ouyang 2025-02-12 20:22:58 +08:00
• 556f773d53 CUDA: fix CUDART_VERSION checks (llama/11821) Johannes Gäßler 2025-02-12 13:16:39 +01:00
• 91d02de332 Fix #11802: Compile bug - RegQueryValueExA changed to RegQueryValueEx (llama/11803) Sheldon Robinson 2025-02-11 10:55:45 -05:00
• 1b67d72f87 CUDA: use arch list for compatibility check (llama/11775) Johannes GäßlerandDiego Devesa 2025-02-11 00:17:22 +01:00
• 14d7c0368d fix: typos in documentation files (llama/11791) Maxim Evtush 2025-02-10 23:21:31 +01:00
• db6e19188a vulkan: Make Vulkan optional at runtime (ggml/11493). (llama/11494) Danny MilosavljevicandJeff Bolz 2025-02-10 07:17:21 +01:00
• b4b063a5c9 vulkan: add environment variable GGML_VK_PREFER_HOST_MEMORY to avoid VRAM allocation (llama/11592) Wagner Bruna 2025-02-10 03:08:22 -03:00
• 930b739e7a vulkan: account for lookup tables when checking shared memory size (llama/11502) Jeff Bolz 2025-02-09 01:43:51 -06:00
• 5981352bb5 ggml: Fix data race in ggml threadpool (llama/11736) Karol Kontny 2025-02-08 15:30:53 +01:00
• 7561da244e CUDA: fix min. version for movmatrix (llama/11751) Johannes Gäßler 2025-02-08 10:46:07 +01:00
• be83f342fb vulkan: print shared memory size (llama/11719) Jeff Bolz 2025-02-07 04:26:03 -06:00
• fd369871f7 SYCL: remove XMX info from print devices (llama/11712) Akarshan Biswas 2025-02-07 14:57:53 +05:30
• bbd8364f5e ggml : optimize and build warning fix for LoongArch (llama/11709) Jinyang He 2025-02-07 15:38:31 +08:00
• e4102440ef SYCL: Adjust support condition for norm operators (llama/11674) Akarshan Biswas 2025-02-06 17:12:35 +05:30
• f8242ec483 ggml : fix LoongArch compile error with 128-bit SIMD (llama/11701) junchao-zhao 2025-02-06 17:20:00 +08:00
• ef51b4cba4 vulkan: optimize coopmat2 iq2/iq3 callbacks (llama/11521) Jeff Bolz 2025-02-06 00:15:30 -06:00
• 6f08b24146 vulkan: initial support for IQ4_XS quantization (llama/11501) Rémy O 2025-02-06 07:09:59 +01:00
• 7c165d7fa8 vulkan: use smaller combined allocations to avoid fragmentation (llama/11551) Jeff Bolz 2025-02-06 00:02:18 -06:00
• 2f0cf44915 metal : avoid breaking build when metal API predates TARGET_OS_VISION (llama/11690) Charles Duffy 2025-02-05 19:52:31 -06:00
• b9c972fd0d metal : adjust support conditions for norm operators (llama/11671) Georgi Gerganov 2025-02-05 10:57:42 +02:00
• 01c9aafbfd CUDA: support for mat. mul. with ne03 != ne13 (llama/11656) Johannes Gäßler 2025-02-05 08:58:31 +01:00
• bae6bbf487 CUDA: non-contiguous (RMS) norm support (llama/11659) Johannes GäßlerandGeorgi Gerganov 2025-02-04 22:21:42 +01:00
• c310272fa0 HIP: force max threads per block to be 1024 (llama/11621) fxzjshm 2025-02-05 02:18:38 +08:00
• bd0b55dbe0 metal : use residency set for other platforms (llama/11648) Jhen-Jie Hong 2025-02-04 19:07:18 +08:00
• ba4645db2c rpc: fix known RCE in rpc-server (ggml/1103) Patrick Peng 2025-02-06 09:29:13 -05:00
• dfc6ca62f3 stream : add beam size parameter(#2836) masahji 2025-02-25 01:39:33 -08:00
• 47e14c0529 whisper : restore big endian support (#2816) Thomas FitzsimmonsandXuan-Son Nguyen 2025-02-25 09:38:13 +00:00
• 00ddb10fe2 select utf8 codepage on windows fix_vs_sdl2 Judd 2025-02-19 16:40:51 +08:00
• b3a6018bbf fix building with MSVC + SDL2 Judd 2025-02-19 14:43:42 +08:00
• d682e15090 Fixes for Windows (#2790) JuddandJudd 2025-02-06 15:37:21 +08:00
• 46d07b9c85 cmake : fix compile assumptions for power9/etc (#2777) midnightandmidnight 2025-02-05 04:41:10 -08:00
• 33ea03f131 authors : update Georgi Gerganov 2025-02-04 13:03:40 +02:00
• dbcc669e1a sync : ggml Georgi Gerganov 2025-02-04 13:03:09 +02:00
• 16245b35e4 cmake: Add ability to pass in GGML_BUILD_NUMBER (ggml/1096) Christian Kastner 2025-02-04 00:17:15 +01:00
• 898c0cb9d1 readme : add maintenance roadmap Georgi Gerganov 2025-02-04 10:50:10 +02:00
• eb9e5032c4 ci : add stalebot Georgi Gerganov 2025-02-04 09:30:08 +02:00
• cadfc50eab node : add max_len params in node addon (#2760) billyct 2025-02-04 04:49:06 +08:00
• 3f91832352 talk-llama : sync llama.cpp Georgi Gerganov 2025-02-03 22:42:26 +02:00
• cff8868b5f coreml : always convert to "neuralnetwork" (#2770) mgrachten 2025-02-03 21:36:32 +01:00
• 90e3c5fc40 ci : more git Georgi Gerganov 2025-02-03 21:17:33 +02:00
• e0f4cef867 ci : install git Georgi Gerganov 2025-02-03 20:12:37 +02:00
• 234460987e ci : use ubuntu-22.04 instead of ubuntu-latest Georgi Gerganov 2025-02-03 19:50:24 +02:00
• b8ab126343 cmake : sync cmake scripts Georgi Gerganov 2025-02-03 16:24:38 +02:00
• edc5d9267c sync : ggml Georgi Gerganov 2025-02-03 16:05:34 +02:00
• 344b98a44f scripts : fix sync paths Georgi Gerganov 2025-02-03 16:05:27 +02:00
• dbeb7916b8 CUDA: fix Volta FlashAttention logic (llama/11615) Johannes Gäßler 2025-02-03 13:25:56 +01:00
• fad2806352 HIP: fix flash_attn_stream_k_fixup warning (llama/11604) Johannes Gäßler 2025-02-02 23:48:29 +01:00
• 9906792ec3 CUDA/HIP: add support for selectable warp size to mmv (llama/11519) uvos 2025-02-02 22:40:09 +01:00
• c49ee07ff4 HIP: add GGML_CUDA_CC_IS_* for amd familys as increasing cc archtectures for amd gpus are not supersets of eatch other (llama/11601) uvos 2025-02-02 22:08:05 +01:00
• f8a831779e CUDA: use mma PTX instructions for FlashAttention (llama/11583) Johannes GäßlerandDiego Devesa 2025-02-02 19:31:09 +01:00
• 85451e3612 ci: use sccache on windows instead of ccache (llama/11545) Olivier Chafik 2025-01-31 17:12:40 +00:00
• 43c744ce8b HIP: require at least HIP 5.5 uvos 2025-01-29 19:36:00 +01:00
• fc2e44490d HIP: Prepare reduction operators for wave 64 uvos 2025-01-29 19:12:42 +01:00
• f41fdad200 CUDA/HIP: add warp_size to cuda_device_info uvos 2025-01-29 17:46:23 +01:00
• 80fa576254 vulkan: implement initial support for IQ2 and IQ3 quantizations (llama/11360) Rémy OudomphengandJeff Bolz 2025-01-29 18:29:39 +01:00
• 75e7d0585e vulkan: Catch pipeline creation failure and print an error message (llama/11436) Jeff Bolz 2025-01-29 09:26:50 -06:00
• 682a6f5f87 HIP: Supress transformation warning in softmax.cu uvos 2025-01-28 23:06:32 +01:00
• 115716d109 HIP: Only call rocblas_initialize on rocblas versions with the multiple instantation bug (llama/11080) Nikita Sarychev 2025-01-28 07:42:20 -08:00
• b2cfef655b cmake : don't fail on GGML_CPU=OFF (llama/11457) someone13574 2025-01-28 09:15:34 -05:00
• 22e3df0afa SYCL : SOFTMAX F16 mask support and other fixes (llama/11261) Akarshan Biswas 2025-01-28 15:26:58 +05:30
• 028511d349 AMD: parse the architecture as supplied by gcnArchName (llama/11244) Haus1 2025-01-27 08:58:17 -05:00
• 70c4038842 metal: Handle null returned from MTLCreateSystemDefaultDevice() (llama/11441) Ihar Hrachyshka 2025-01-27 02:41:59 -05:00
• 8639c003a9 metal : use residency sets (llama/11427) Georgi Gerganov 2025-01-26 20:06:16 +02:00
• d5d831da65 cmake: add ggml find package (llama/11369) bandotiandGeorgi Gerganov 2025-01-26 12:07:48 -04:00
• 7230a6e1c8 vulkan: compile shaders on-demand (llama/11406) Jeff Bolz 2025-01-25 15:29:57 -06:00
• a160fa0f3a Hip: disable VMM on hip as it seams that it dosent work in some configurations (llama/11420) uvos 2025-01-25 21:01:12 +01:00
• 0282ad8fd1 hip : Add hipGraph and VMM support to ROCM (llama/11362) uvos 2025-01-25 00:02:23 +01:00
• 9e467815d4 CUDA: fix FP16 cuBLAS GEMM (llama/11396) Johannes Gäßler 2025-01-24 21:02:43 +01:00
• 727891d9bf rocBLAS: Avoid fp32->fp16->fp32 conversion on cdna (llama/11356) uvos 2025-01-24 17:50:49 +01:00
• c262dc80e2 CPU/CUDA: fix (GQA) mul mat back, add CUDA support (llama/11380) Johannes Gäßler 2025-01-24 12:38:31 +01:00
• 30767b4c4e cmake : avoid -march=native when reproducible build is wanted (llama/11366) Bernhard M. Wiedemann 2025-01-24 12:21:35 +01:00
• 16eeb31933 Vulkan-run-test: fix mmq_wg_denoms (llama/11343) amd-dwang 2025-01-23 15:14:28 +08:00
• ba523d5e22 vulkan: sort shaders for more deterministic binary (llama/11315) Jeff Bolz 2025-01-23 01:07:50 -06:00
• 3736706139 vulkan: fix diag_mask_inf (llama/11323) Jeff Bolz 2025-01-23 01:01:17 -06:00
• 58640aa456 rpc : better caching of the base buffer pointer (llama/11331) Radoslav Gerganov 2025-01-21 15:06:41 +02:00
• 5183a05e56 metal : fix out-of-bounds write (llama/11314) Georgi Gerganov 2025-01-21 08:48:13 +02:00
• 0dcada42d4 vulkan: fix coopmat2 validation failures (llama/11284) Jeff Bolz 2025-01-20 10:38:32 -06:00