Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

sync-ggml-26-07-30

talk.llama-coreml

threads

timing

try-fix-abort

whisper-rc-v1.9.4

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3422

#3422

#3423

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3934

#3934

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3947

#3948

#3948

#3950

#3956

#3957

#3959

#3962

#3963

#3964

#3964

#3966

#3969

#3970

#3972

#3975

#3976

#3976

#3977

#3979

#398

#3980

#3980

#3981

#3982

#3985

#3987

#3987

#3989

#3990

#3991

#3994

#3996

#3997

#3998

#3999

#4000

#4001

#4002

#4003

#4004

#4005

#4006

#4007

#4008

#4009

#4010

#4012

#4013

#4015

#4016

#4017

#4019

#4020

#4020

#4021

#4021

#4022

#4023

#4023

#4025

#4028

#4028

#4029

#4031

#4032

#4033

#4033

#4034

#4035

#4038

#404

#4040

#4044

#4045

#4047

#4048

#4049

#4049

#4050

#4051

#4052

#4053

#4054

#4054

#4055

#4055

#4056

#4057

#4058

#4060

#4061

#4064

#4065

#4066

#4066

#4068

#4068

#4069

#4070

#4072

#4073

#4074

#4077

#4079

#4080

#4082

#4083

#4086

#4086

#4087

#4087

#4089

#4089

#409

#4091

#4095

#4095

#4096

#4096

#4097

#4097

#41

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

b4938

b5127

b5130

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

v1.9.2

v1.9.3

v1.9.4

Mono Color

• 12638dfef0 vulkan: select only one device for single gpu with multiple drivers (llama/7582) k.h.lai 2024-06-12 03:26:05 +08:00
• f100b3b523 Update Vulkan RoPE implementation (llama/7818) 0cc4mandslaren 2024-06-11 21:20:29 +02:00
• a99e213a82 CUDA: int8 tensor cores for MMQ (q4_K, q5_K, q6_K) (llama/7860) Johannes Gäßler 2024-06-11 08:26:07 +02:00
• 7483d2b61c CUDA: use tensor cores for MMQ (llama/7676) Johannes Gäßler 2024-06-10 11:45:13 +02:00
• 1fe5948227 use the correct SYCL context for host USM allocations (llama/7777) Ben Ashbaugh 2024-06-10 02:21:31 -07:00
• 760497e1ab CUDA: revise q8_1 data layout for mul_mat_q (llama/7824) Johannes Gäßler 2024-06-09 09:42:25 +02:00
• b172e7714c vulkan : reuse parent extra for views (llama/7806) slarenand0cc4m 2024-06-07 19:47:49 +02:00
• dc01aadb18 fix softmax r2r result wrong issue (llama/7811) pengxin99 2024-06-07 14:28:26 +08:00
• e08c62149b CUDA: refactor mmq, dmmv, mmvq (llama/7716) Johannes Gäßler 2024-06-05 16:53:00 +02:00
• abab4500fa ggml : refactor rope norm/neox (llama/7634) Georgi Gerganov 2024-06-05 11:29:20 +03:00
• e666315fa8 Allow number of nodes in CUDA graph to change (llama/7738) agray3 2024-06-04 21:06:49 +01:00
• 3f869af14c ggml : remove OpenCL (llama/7735) Georgi Gerganov 2024-06-04 21:23:20 +03:00
• cbacb7634c ggml : prevent builds with -ffinite-math-only (llama/7726) Georgi Gerganov 2024-06-04 10:01:09 +03:00
• 6cc3b022ee llama : offload to RPC in addition to other backends (llama/7640) Radoslav Gerganovandslaren 2024-06-03 20:03:26 +03:00
• e5e38d4920 ggml : use OpenMP as a thread pool (llama/7606) 3 people 2024-06-04 00:14:15 +09:00
• 2a6bab5655 Vulkan Mixture of Experts (MoE) support (llama/7628) 0cc4m 2024-06-03 10:59:14 +02:00
• 8c01c9b85c kompute : implement op_getrows_f32 (llama/6403) woachk 2024-06-03 07:32:16 +02:00
• d1123d795e fix bug introduced in using calloc (llama/7701) Dave Airlie 2024-06-03 07:59:54 +10:00
• 9b3d784020 Fix FlashAttention debug test, FP32 assert (llama/7684) Johannes Gäßler 2024-06-01 23:26:10 +02:00
• a16137d13d CUDA: fix Pascal FA, deq. KV to FP16 for batch > 8 (llama/7681) Johannes Gäßler 2024-06-01 15:47:04 +02:00
• 5582039d0a CUDA: quantized KV support for FA vec (llama/7527) Johannes Gäßler 2024-06-01 08:44:14 +02:00
• 9a16c643e2 ggml : fix loongson compile warnings (llama/7537) Georgi Gerganovandjunchao-loongson 2024-05-31 14:17:10 +03:00
• 10a8a23100 faster avx512 exp implementation (llama/7551) Chris Elrod 2024-05-30 07:32:55 -04:00
• 29cfeef77f ggml : fix loongarch build (O2 issue) (llama/7636) junchao-loongson 2024-05-30 17:30:10 +08:00
• e66e9ea25b metal : remove invalid asserts (llama/7617) Georgi Gerganov 2024-05-29 22:20:40 +03:00
• 276779a849 metal : add missing asserts (llama/7617) Georgi Gerganov 2024-05-29 20:45:25 +03:00
• 1f35ce61c1 ggml : fix YARN + add tests + add asserts (llama/7617) Georgi Gerganov 2024-05-29 20:17:31 +03:00
• 4b19cc3ed4 cuda : non-cont concat support (llama/7610) Georgi Gerganov 2024-05-29 15:38:26 +03:00
• a535d348dd llama-bench : add support for the RPC backend (llama/7435) Radoslav Gerganov 2024-05-29 14:45:44 +03:00
• 8f5dc729d9 ggml : use atomic_flag for critical section (llama/7598) slaren 2024-05-29 13:36:39 +02:00
• 02fc147a0b examples : adapt to new ggml_concat (ggml/0) Georgi Gerganov 2024-05-29 12:58:00 +03:00
• 109148ac84 ggml : fix typo in ggml.c (llama/7603) zhouwg 2024-05-29 10:09:31 +08:00
• 3563473d2c Align GEMM dispatch (llama/7566) Meng, Hengyu 2024-05-29 07:00:24 +08:00
• 046834198d sycl : fix assert (llama/7563) Georgi Gerganov 2024-05-28 22:22:50 +03:00
• 0a2ad9de06 vulkan: properly initialize vulkan devices for LLAMA_SPLIT_MODE_NONE (llama/7552) k.h.lai 2024-05-29 01:25:08 +08:00
• 39b0640b09 rpc : resource management rework (llama/7562) Radoslav Gerganov 2024-05-28 18:13:36 +03:00
• 8dca71de64 fix ggml_sycl_mul_mat_id() to match the change of api (llama/7436) Neo Zhang 2024-05-28 17:53:37 +08:00
• 812787cbc5 ggml : generalize GGML_OP_CONCAT (llama/7563) Georgi Gerganov 2024-05-28 11:04:19 +03:00
• 68ef10805e update HIP_UMA #7399 (llama/7414) Djip007andslaren 2024-05-28 01:40:47 +02:00
• 96fdb90f5f Allow multiple copy function pointers for CUDA graph kernel param updates (llama/7565) agray3 2024-05-27 18:33:42 +01:00
• e98f9ac554 Fix q_xxs using mul_mat_q (llama/7459) AidanBeltonS 2024-05-27 17:34:51 +01:00
• 02d481595b Add freq factors (llama/7495) AidanBeltonS 2024-05-27 13:34:09 +01:00
• 7091c7ab5a metal : add GGML_OP_REPEAT kernels (llama/7557) Georgi Gerganov 2024-05-27 12:10:19 +03:00
• d70ccb75f5 metal : disable FA kernel for HS=256 (llama/7556) Georgi Gerganov 2024-05-27 10:38:39 +03:00
• 5ee048eb67 ggml : restore ggml_rope_xpos_inplace (ggml/0) Georgi Gerganov 2024-05-26 18:35:23 +03:00
• 37ed71c964 ggml: aarch64: SVE kernels for q8_0_q8_0, q4_0_q8_0 vector dot (llama/7433) Masaya, Kato 2024-05-25 17:42:31 +09:00
• 8cd7a3df37 ggml : silence UB sanitizer error during iq2_xxs quantization (llama/0) Georgi Gerganov 2024-05-23 17:17:43 +03:00
• 04a3279320 ggml : remove ggml_flash_attn and ggml_flash_ff (llama/7463) Georgi Gerganov 2024-05-23 10:00:44 +03:00
• 45ddda8e0c ggml : drop support for QK_K=64 (llama/7473) Georgi Gerganov 2024-05-23 10:00:21 +03:00
• c41317fd66 Update vulkan rope implementation to support frequency factors (llama/7475) 0cc4m 2024-05-23 08:59:59 +02:00
• 96b8419b27 CUDA: fix FA out-of-bounds reads (llama/7479) Johannes Gäßler 2024-05-23 00:31:20 +02:00
• 3c63f4cf35 CUDA: fix FA out-of-bounds writes (llama/7465) Johannes Gäßler 2024-05-22 17:58:25 +02:00
• 5848dfd9c8 cuda : fix compile warning (llama/7454) Georgi Gerganov 2024-05-22 12:36:37 +03:00
• 29ab5d0326 CUDA: remove incorrect precision check (llama/7454) Johannes Gäßler 2024-05-22 10:24:29 +02:00
• c4d6958b3e cuda : fix rope + add tests (llama/7452) Georgi Gerganov 2024-05-22 11:01:35 +03:00
• c9dcb75118 llama : add phi3 128K model support (llama/7225) liuwei-gitandGeorgi Gerganov 2024-05-22 04:28:32 +08:00
• bbdbc3fc62 metal : handle F16 inf values, fix FA partial offload (llama/7434) Georgi Gerganov 2024-05-21 23:03:42 +03:00
• 28c207a541 CUDA: fix unused warning in mmq.cu (llama/7442) Johannes Gäßler 2024-05-21 19:27:12 +02:00
• c23f830983 CUDA: deduplicate mmq code (llama/7397) Johannes Gäßler 2024-05-21 16:02:12 +02:00
• caeeb32b41 rpc : track allocated buffers (llama/7411) Radoslav Gerganov 2024-05-20 16:36:55 +03:00
• 584cc1177a Update SYCL upscale operation (llama/7321) AidanBeltonS 2024-05-20 12:08:23 +01:00
• cc1ae10989 ggml-opencl, llama: using reserve() if count already known (llama/7272) Herman Semenov 2024-05-20 07:33:21 +00:00
• eb26f55b40 ggml : add loongarch lsx and lasx support (llama/6454) junchao-loongsonandJinyang He 2024-05-20 15:19:21 +08:00
• eb2b086584 Add provisions for windows support for BF16 code including CMake provision for enabling AVX512_BF16 (llama/7258) Srihari-mcw 2024-05-19 19:18:39 -07:00
• 67919cfe11 Vulkan Embedding Fix (llama/7360) 0cc4m 2024-05-19 17:19:53 +02:00
• bf5fc81a8a ggml : fix another case of quants nans (llama/7387) slaren 2024-05-19 17:08:46 +02:00
• 2b07dc3186 ggml: implement quantized KV cache for FA (llama/7372) Johannes Gäßler 2024-05-19 16:46:13 +02:00
• 951c463d39 cuda : clear error after buffer allocation failure (llama/7376) slaren 2024-05-19 14:19:37 +02:00
• 7f257b210f Capture CUDA logging output (llama/7298) fraxy-vandslaren 2024-05-19 01:44:42 +03:00
• 705fe30a02 android : use "ci-android" branch for CI (llama/7341) Georgi Gerganov 2024-05-18 13:40:39 +03:00
• 45b5b95e29 CUDA: deduplicate FlashAttention code (llama/7352) Johannes Gäßler 2024-05-18 12:36:25 +02:00
• f2c47d1e6a cuda : add half2 __shfl_xor() for ROCm 5.5 (llama/7263) Engininja2 2024-05-18 02:05:17 -06:00
• b4bb9b9036 Update and fix Vulkan soft_max and argsort implementations (llama/7237) 0cc4m 2024-05-18 08:10:58 +02:00
• 2bc6483299 ggml : fix quants nans when all the group weights are very close to zero (llama/7313) slaren 2024-05-18 02:39:54 +02:00
• ec52f900e4 CUDA: faster large batch FA without tensor cores (llama/7314) Johannes Gäßler 2024-05-17 18:54:52 +02:00
• 77d708fabb rpc : set SO_REUSEADDR for the server socket (llama/7320) Radoslav Gerganov 2024-05-17 17:25:44 +03:00
• c00149c861 ggml-quants, llama : removed excess checks (llama/7274) Herman Semenov 2024-05-17 07:08:49 +00:00
• 574661f2e6 ggml : rewrite silu and softmax for cpu (llama/7154) Justine Tunney 2024-05-17 02:58:52 -04:00
• 7bd69349bf rpc : add command line arg for specifying backend memory Radoslav Gerganov 2024-05-15 15:29:07 +03:00
• 488ad99c13 Add support for properly optimized Windows ARM64 builds with LLVM and MSVC (llama/7191) Max KrasnyanskyandGeorgi Gerganov 2024-05-15 19:47:36 -07:00
• 7178cceeaa ggml : use dynamic thread scheduling for matrix multiplication (llama/6915) kunnis 2024-05-15 12:59:12 -05:00
• 8d55ccdb8c Avoid unnecessarily disabling CUDA graphs (llama/7302) agray3 2024-05-15 14:44:49 +01:00
• 37a72cb170 ggml : tag ggml_tensor::backend as deprecated (llama/7290) slaren 2024-05-15 15:08:48 +02:00
• bf9b69284f Add missing " (llama/7303) AidanBeltonS 2024-05-15 13:26:30 +01:00
• c4de1e19df ggml : add ggml_upscale_ext (ggml/814) John BalisandGeorgi Gerganov 2024-05-15 03:52:33 -05:00
• 5b7073cae1 scripts : update sync Georgi Gerganov 2024-06-16 12:41:42 +03:00
• b29b3b2924 whisper : use ggml-cuda in mel calc, set appropriate device (#2236) Borislav Stanimirov 2024-06-13 13:16:07 +03:00
• 267e15a46d cuda : avoid async allocs in CUDA mel code gg/cuda-no-async Georgi Gerganov 2024-06-12 09:52:15 +03:00
• 420b6abc54 cuda : fix HIPBLAS build (#2234) Georgi Gerganov 2024-06-11 19:14:38 +03:00
• 5801b8ac64 cuda : fix HIPBLAS build gg/hipblas-fix Georgi Gerganov 2024-06-11 19:13:43 +03:00
• 99804b0f3e cuda : fix bounds check for src0 rows in MMVQ kernel (#2231) Georgi GerganovandJohannes Gäßler 2024-06-11 17:39:01 +03:00
• 13c5446759 Update ggml-cuda/mmvq.cu gg/cuda-fix-mmvq Georgi GerganovandJohannes Gäßler 2024-06-11 17:37:32 +03:00
• c55964c956 ci : fix CUDA builds (#2232) Georgi Gerganov 2024-06-11 17:21:30 +03:00
• 059bcd3009 ci : fix CUDA builds gg/ci-cuda-fix Georgi Gerganov 2024-06-11 11:40:19 +03:00
• 9df6298a91 cuda : fix bounds check for src0 rows in MMVQ kernel Georgi Gerganov 2024-06-11 11:30:12 +03:00
• 20c542c713 whisper : auto-grow working areas for mel_calc_cuda (#2227) Borislav Stanimirov 2024-06-10 21:51:32 +03:00
• c2bdb960cd whisper : free whisper_mel instances (#2220) Georgi Gerganov 2024-06-10 10:59:36 +03:00
• 87acd6d629 whisper : whisper_state/backend fixes (#2217) Georgi Gerganov 2024-06-06 18:51:36 +03:00
• f842d31171 whisper : calculate mel spectrogram directly into a ggml_tensor (#2208) Borislav Stanimirov 2024-06-06 16:20:46 +03:00
• ffef323c4c whisper : add CUDA-specific computation mel spectrograms (#2206) Borislav Stanimirov 2024-06-04 09:32:23 +03:00