Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

sync-ggml-26-07-30

talk.llama-coreml

threads

timing

try-fix-abort

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3419

#3422

#3422

#3423

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3934

#3934

#3936

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3946

#3947

#3948

#3948

#3950

#3956

#3956

#3957

#3957

#3959

#3962

#3963

#3963

#398

#404

#409

#41

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

Mono Color

• 5d950c4b8d whisper : use ggml_backend_sched (#2239) Georgi Gerganov 2024-06-18 09:37:20 +03:00
• 820446e230 fix : remove extra files Georgi Gerganov 2024-06-16 19:23:55 +03:00
• 54d5823ebe scripts : sync ggml-blas Georgi Gerganov 2024-06-16 19:23:32 +03:00
• 5181494e9f build : update make / cmake Georgi Gerganov 2024-06-16 19:10:20 +03:00
• 4a6e6e8b30 sync : ggml Georgi Gerganov 2024-06-16 18:40:07 +03:00
• de29b193f6 move BLAS to a separate backend (cont) (llama/6210) slaren 2024-06-16 13:57:37 +03:00
• 922971041b Vulkan Shader Refactor, Memory Debugging Option (llama/7947) 0cc4m 2024-06-16 07:17:31 +02:00
• 63a767a134 scripts : stop sync whisper example from ggml Georgi Gerganov 2024-06-16 18:38:46 +03:00
• 30841fa786 cmake : fix sycl build (#0) Georgi Gerganov 2024-06-16 17:57:35 +03:00
• 3b1ac03828 ggml : remove OpenCL (#0) Georgi Gerganov 2024-06-16 13:46:12 +03:00
• 990de617b5 sycl : sync (#0) Georgi Gerganov 2024-06-16 13:24:17 +03:00
• 6975600b4b cuda : enable CUDA graphs (#0) Georgi Gerganov 2024-06-16 13:20:19 +03:00
• 061eeb9f61 talk-llama : sync llama.cpp Georgi Gerganov 2024-06-16 13:10:54 +03:00
• 4942b1b428 cmake : fix CUDA build (#0) Georgi Gerganov 2024-06-16 13:07:43 +03:00
• 3c7cc5c437 sync : ggml Georgi Gerganov 2024-06-16 12:43:14 +03:00
• 5cd42ee2cc ggml : fix and optimize ppc64le (ggml/849) Hong Bo PENG 2024-06-16 16:53:11 +08:00
• ee718f3da6 ggml : remove duplicate include of ggml-common.h (ggml/853) Daniel Bevenius 2024-06-16 10:51:18 +02:00
• 63eac1f608 remove global variables (llama/7710) Meng, Hengyu 2024-06-15 14:05:10 +08:00
• b17ba2815b CUDA: faster q2_K, q3_K MMQ + int8 tensor cores (llama/7921) Johannes Gäßler 2024-06-14 18:41:49 +02:00
• 7a489af2f3 metal : utilize max shared memory for mul_mat_id (llama/7935) Georgi Gerganov 2024-06-14 17:14:09 +03:00
• 4a4ea13d6d rpc : fix ggml_backend_rpc_supports_buft() (llama/7918) Radoslav Gerganov 2024-06-13 15:18:44 +03:00
• 174a461fc6 move BLAS to a separate backend (llama/6210) slaren 2024-06-13 03:11:35 +02:00
• d8b7a24bc9 CUDA: fix broken oob check for FA vec f32 kernel (llama/7904) Johannes Gäßler 2024-06-12 17:41:51 +02:00
• acf3832c9c tests : add non-cont unary tests (llama/7857) Georgi Gerganov 2024-06-12 16:00:22 +03:00
• d29ac44303 ggml : improve ggml_is_contiguous logic (llama/7856) Georgi Gerganov 2024-06-12 15:24:20 +03:00
• 12638dfef0 vulkan: select only one device for single gpu with multiple drivers (llama/7582) k.h.lai 2024-06-12 03:26:05 +08:00
• f100b3b523 Update Vulkan RoPE implementation (llama/7818) 0cc4m 2024-06-11 21:20:29 +02:00
• a99e213a82 CUDA: int8 tensor cores for MMQ (q4_K, q5_K, q6_K) (llama/7860) Johannes Gäßler 2024-06-11 08:26:07 +02:00
• 7483d2b61c CUDA: use tensor cores for MMQ (llama/7676) Johannes Gäßler 2024-06-10 11:45:13 +02:00
• 1fe5948227 use the correct SYCL context for host USM allocations (llama/7777) Ben Ashbaugh 2024-06-10 02:21:31 -07:00
• 760497e1ab CUDA: revise q8_1 data layout for mul_mat_q (llama/7824) Johannes Gäßler 2024-06-09 09:42:25 +02:00
• b172e7714c vulkan : reuse parent extra for views (llama/7806) slaren 2024-06-07 19:47:49 +02:00
• dc01aadb18 fix softmax r2r result wrong issue (llama/7811) pengxin99 2024-06-07 14:28:26 +08:00
• e08c62149b CUDA: refactor mmq, dmmv, mmvq (llama/7716) Johannes Gäßler 2024-06-05 16:53:00 +02:00
• abab4500fa ggml : refactor rope norm/neox (llama/7634) Georgi Gerganov 2024-06-05 11:29:20 +03:00
• e666315fa8 Allow number of nodes in CUDA graph to change (llama/7738) agray3 2024-06-04 21:06:49 +01:00
• 3f869af14c ggml : remove OpenCL (llama/7735) Georgi Gerganov 2024-06-04 21:23:20 +03:00
• cbacb7634c ggml : prevent builds with -ffinite-math-only (llama/7726) Georgi Gerganov 2024-06-04 10:01:09 +03:00
• 6cc3b022ee llama : offload to RPC in addition to other backends (llama/7640) Radoslav Gerganov 2024-06-03 20:03:26 +03:00
• e5e38d4920 ggml : use OpenMP as a thread pool (llama/7606) Masaya, Kato 2024-06-04 00:14:15 +09:00
• 2a6bab5655 Vulkan Mixture of Experts (MoE) support (llama/7628) 0cc4m 2024-06-03 10:59:14 +02:00
• 8c01c9b85c kompute : implement op_getrows_f32 (llama/6403) woachk 2024-06-03 07:32:16 +02:00
• d1123d795e fix bug introduced in using calloc (llama/7701) Dave Airlie 2024-06-03 07:59:54 +10:00
• 9b3d784020 Fix FlashAttention debug test, FP32 assert (llama/7684) Johannes Gäßler 2024-06-01 23:26:10 +02:00
• a16137d13d CUDA: fix Pascal FA, deq. KV to FP16 for batch > 8 (llama/7681) Johannes Gäßler 2024-06-01 15:47:04 +02:00
• 5582039d0a CUDA: quantized KV support for FA vec (llama/7527) Johannes Gäßler 2024-06-01 08:44:14 +02:00
• 9a16c643e2 ggml : fix loongson compile warnings (llama/7537) Georgi Gerganov 2024-05-31 14:17:10 +03:00
• 10a8a23100 faster avx512 exp implementation (llama/7551) Chris Elrod 2024-05-30 07:32:55 -04:00
• 29cfeef77f ggml : fix loongarch build (O2 issue) (llama/7636) junchao-loongson 2024-05-30 17:30:10 +08:00
• e66e9ea25b metal : remove invalid asserts (llama/7617) Georgi Gerganov 2024-05-29 22:20:40 +03:00
• 276779a849 metal : add missing asserts (llama/7617) Georgi Gerganov 2024-05-29 20:45:25 +03:00
• 1f35ce61c1 ggml : fix YARN + add tests + add asserts (llama/7617) Georgi Gerganov 2024-05-29 20:17:31 +03:00
• 4b19cc3ed4 cuda : non-cont concat support (llama/7610) Georgi Gerganov 2024-05-29 15:38:26 +03:00
• a535d348dd llama-bench : add support for the RPC backend (llama/7435) Radoslav Gerganov 2024-05-29 14:45:44 +03:00
• 8f5dc729d9 ggml : use atomic_flag for critical section (llama/7598) slaren 2024-05-29 13:36:39 +02:00
• 02fc147a0b examples : adapt to new ggml_concat (ggml/0) Georgi Gerganov 2024-05-29 12:58:00 +03:00
• 109148ac84 ggml : fix typo in ggml.c (llama/7603) zhouwg 2024-05-29 10:09:31 +08:00
• 3563473d2c Align GEMM dispatch (llama/7566) Meng, Hengyu 2024-05-29 07:00:24 +08:00
• 046834198d sycl : fix assert (llama/7563) Georgi Gerganov 2024-05-28 22:22:50 +03:00
• 0a2ad9de06 vulkan: properly initialize vulkan devices for LLAMA_SPLIT_MODE_NONE (llama/7552) k.h.lai 2024-05-29 01:25:08 +08:00
• 39b0640b09 rpc : resource management rework (llama/7562) Radoslav Gerganov 2024-05-28 18:13:36 +03:00
• 8dca71de64 fix ggml_sycl_mul_mat_id() to match the change of api (llama/7436) Neo Zhang 2024-05-28 17:53:37 +08:00
• 812787cbc5 ggml : generalize GGML_OP_CONCAT (llama/7563) Georgi Gerganov 2024-05-28 11:04:19 +03:00
• 68ef10805e update HIP_UMA #7399 (llama/7414) Djip007 2024-05-28 01:40:47 +02:00
• 96fdb90f5f Allow multiple copy function pointers for CUDA graph kernel param updates (llama/7565) agray3 2024-05-27 18:33:42 +01:00
• e98f9ac554 Fix q_xxs using mul_mat_q (llama/7459) AidanBeltonS 2024-05-27 17:34:51 +01:00
• 02d481595b Add freq factors (llama/7495) AidanBeltonS 2024-05-27 13:34:09 +01:00
• 7091c7ab5a metal : add GGML_OP_REPEAT kernels (llama/7557) Georgi Gerganov 2024-05-27 12:10:19 +03:00
• d70ccb75f5 metal : disable FA kernel for HS=256 (llama/7556) Georgi Gerganov 2024-05-27 10:38:39 +03:00
• 5ee048eb67 ggml : restore ggml_rope_xpos_inplace (ggml/0) Georgi Gerganov 2024-05-26 18:35:23 +03:00
• 37ed71c964 ggml: aarch64: SVE kernels for q8_0_q8_0, q4_0_q8_0 vector dot (llama/7433) Masaya, Kato 2024-05-25 17:42:31 +09:00
• 8cd7a3df37 ggml : silence UB sanitizer error during iq2_xxs quantization (llama/0) Georgi Gerganov 2024-05-23 17:17:43 +03:00
• 04a3279320 ggml : remove ggml_flash_attn and ggml_flash_ff (llama/7463) Georgi Gerganov 2024-05-23 10:00:44 +03:00
• 45ddda8e0c ggml : drop support for QK_K=64 (llama/7473) Georgi Gerganov 2024-05-23 10:00:21 +03:00
• c41317fd66 Update vulkan rope implementation to support frequency factors (llama/7475) 0cc4m 2024-05-23 08:59:59 +02:00
• 96b8419b27 CUDA: fix FA out-of-bounds reads (llama/7479) Johannes Gäßler 2024-05-23 00:31:20 +02:00
• 3c63f4cf35 CUDA: fix FA out-of-bounds writes (llama/7465) Johannes Gäßler 2024-05-22 17:58:25 +02:00
• 5848dfd9c8 cuda : fix compile warning (llama/7454) Georgi Gerganov 2024-05-22 12:36:37 +03:00
• 29ab5d0326 CUDA: remove incorrect precision check (llama/7454) Johannes Gäßler 2024-05-22 10:24:29 +02:00
• c4d6958b3e cuda : fix rope + add tests (llama/7452) Georgi Gerganov 2024-05-22 11:01:35 +03:00
• c9dcb75118 llama : add phi3 128K model support (llama/7225) liuwei-git 2024-05-22 04:28:32 +08:00
• bbdbc3fc62 metal : handle F16 inf values, fix FA partial offload (llama/7434) Georgi Gerganov 2024-05-21 23:03:42 +03:00
• 28c207a541 CUDA: fix unused warning in mmq.cu (llama/7442) Johannes Gäßler 2024-05-21 19:27:12 +02:00
• c23f830983 CUDA: deduplicate mmq code (llama/7397) Johannes Gäßler 2024-05-21 16:02:12 +02:00
• caeeb32b41 rpc : track allocated buffers (llama/7411) Radoslav Gerganov 2024-05-20 16:36:55 +03:00
• 584cc1177a Update SYCL upscale operation (llama/7321) AidanBeltonS 2024-05-20 12:08:23 +01:00
• cc1ae10989 ggml-opencl, llama: using reserve() if count already known (llama/7272) Herman Semenov 2024-05-20 07:33:21 +00:00
• eb26f55b40 ggml : add loongarch lsx and lasx support (llama/6454) junchao-loongson 2024-05-20 15:19:21 +08:00
• eb2b086584 Add provisions for windows support for BF16 code including CMake provision for enabling AVX512_BF16 (llama/7258) Srihari-mcw 2024-05-19 19:18:39 -07:00
• 67919cfe11 Vulkan Embedding Fix (llama/7360) 0cc4m 2024-05-19 17:19:53 +02:00
• bf5fc81a8a ggml : fix another case of quants nans (llama/7387) slaren 2024-05-19 17:08:46 +02:00
• 2b07dc3186 ggml: implement quantized KV cache for FA (llama/7372) Johannes Gäßler 2024-05-19 16:46:13 +02:00
• 951c463d39 cuda : clear error after buffer allocation failure (llama/7376) slaren 2024-05-19 14:19:37 +02:00
• 7f257b210f Capture CUDA logging output (llama/7298) fraxy-v 2024-05-19 01:44:42 +03:00
• 705fe30a02 android : use "ci-android" branch for CI (llama/7341) Georgi Gerganov 2024-05-18 13:40:39 +03:00
• 45b5b95e29 CUDA: deduplicate FlashAttention code (llama/7352) Johannes Gäßler 2024-05-18 12:36:25 +02:00
• f2c47d1e6a cuda : add half2 __shfl_xor() for ROCm 5.5 (llama/7263) Engininja2 2024-05-18 02:05:17 -06:00
• b4bb9b9036 Update and fix Vulkan soft_max and argsort implementations (llama/7237) 0cc4m 2024-05-18 08:10:58 +02:00
• 2bc6483299 ggml : fix quants nans when all the group weights are very close to zero (llama/7313) slaren 2024-05-18 02:39:54 +02:00
• ec52f900e4 CUDA: faster large batch FA without tensor cores (llama/7314) Johannes Gäßler 2024-05-17 18:54:52 +02:00