whisper.cpp

upstream-archive/whisper.cpp

Fork 0

mirror of https://github.com/ggml-org/whisper.cpp.git synced 2026-07-31 07:00:50 -05:00

Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

sync-ggml-26-07-30

talk.llama-coreml

threads

timing

try-fix-abort

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3419

#3422

#3422

#3423

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3934

#3934

#3936

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3946

#3947

#3948

#3948

#3950

#3956

#3956

#3957

#3957

#3959

#3962

#3963

#3963

#398

#404

#409

#41

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

3ffc83d90a swift : package no longer use ggml dependency (#1861) Georgi Gerganov 2024-02-12 19:54:11 +02:00
e3c5e2cba8 whisper : fix external encoder (#1860) Georgi Gerganov 2024-02-12 19:53:51 +02:00
b742f13e70 sync : ggml Georgi Gerganov 2024-02-12 19:07:56 +02:00
52c529eeb1 ggml-alloc : allocate all leafs as if they were inputs (ggml/731) slaren 2024-02-12 18:07:14 +01:00
f25edade2b whisper : alternative way to handle the external encoders gg/fix-external-encoder Georgi Gerganov 2024-02-12 16:32:26 +02:00
74c260fe34 whisper : fix usage of extenral encoders (e.g. CoreML) Georgi Gerganov 2024-02-12 15:19:59 +02:00
551529290d talk-llama : sync llama.cpp Georgi Gerganov 2024-02-12 10:39:58 +02:00
25a90ffa38 sync : ggml Georgi Gerganov 2024-02-12 09:32:15 +02:00
866b67ca93 ggml-backend : sync remnant Georgi Gerganov 2024-02-12 09:27:57 +02:00
d7e9f58f7f CUDA: mul_mat_vec_q tiling, refactor mul mat logic (llama/5434) Johannes Gäßler 2024-02-11 19:08:39 +01:00
04839bae22 vulkan: only use M-sized matmul on Apple GPUs (llama/5412) Sergio López 2024-02-11 15:12:00 +01:00
3cc6e04a52 ggml : fix compile warnings (unused vars) (llama/4966) Georgi Gerganov 2024-02-11 15:33:01 +02:00
b7ef178b9c ggml : add mmla kernels for quantized GEMM (llama/4966) snadampal 2024-02-11 07:22:33 -06:00
47dfe9d4db metal : use autoreleasepool to avoid memory leaks (llama/5437) Ian Bull 2024-02-10 02:53:28 -08:00
1d3270cc8f ggml-alloc : v3 (ggml/727) slaren 2024-02-11 13:37:58 +01:00
a6fb6ab597 examples : added audio_ctx argument to main and server (#1857) dscripka 2024-02-12 02:19:07 -05:00
163e74b6c3 metal : option to embed MSL source into compiled binary (#1842) Didzis Gosko 2024-02-11 16:41:41 +02:00
f273e66dc6 examples : initialize context params properly (#1852) Georgi Gerganov 2024-02-11 16:39:12 +02:00
02b4c52c12 talk-llama : sync llama.cpp Georgi Gerganov 2024-02-10 10:10:59 +02:00
518199c09e sync : ggml Georgi Gerganov 2024-02-10 09:56:47 +02:00
8b17a2f776 src : relocate new backend sources Georgi Gerganov 2024-02-10 09:50:24 +02:00
b6d2827914 ggml : fix error C2078: too many initializers for MSVC ARM64 (llama/5404) Michael Podvitskiy 2024-02-09 10:56:43 +01:00
9711bae0b3 CUDA: more warps for mmvq on NVIDIA (llama/5394) Johannes Gäßler 2024-02-08 21:56:40 +01:00
eec38f63bd CUDA: fixed mmvq kernel for bs 2,3,4 and -sm row (llama/5386) Johannes Gäßler 2024-02-07 12:40:26 +01:00
ef5e6b746f Basic Vulkan Multi-GPU implementation (llama/5321) 0cc4m 2024-02-07 07:54:50 +01:00
77bf6b5f56 CUDA: mul_mat_vec_q max. batch size 8 -> 4 (llama/5370) Johannes Gäßler 2024-02-06 18:43:06 +01:00
b562fff9d0 Slight quantization improvement for Q4_K and Q5_K (llama/5361) Kawrakow 2024-02-06 17:28:02 +02:00
b5dec374f4 CUDA: mul_mat_vec_q for batch sizes > 1 (llama/5351) Johannes Gäßler 2024-02-06 14:44:06 +01:00
fa0dc6167c ggml : make use of ggml-quants.h possible in C++ code (llama/5338) Kawrakow 2024-02-05 14:09:47 +02:00
55bcd62a4b ggml : avoid duplicating function calls using MIN/MAX macros (llama/5325) Dr. Tom Murphy VII Ph.D 2024-02-05 06:13:57 -05:00
0ed762d691 iq2_xxs: tune quantization (llama/5320) Kawrakow 2024-02-05 10:46:06 +02:00
1b5bb7792e cuda : fix LLAMA_CUDA_F16 (llama/5262) slaren 2024-02-01 18:30:17 +01:00
9b735cea77 metal : add im2col F32 dst support (llama/5132) Georgi Gerganov 2024-01-31 15:35:41 +02:00
12c462d656 llava : add MobileVLM support (llama/5132) JidongZhang-THU 2024-01-31 21:10:15 +08:00
fc7b0e2c28 ggml : limit n_threads to the max n_tasks (llama/5238) slaren 2024-01-31 13:43:03 +01:00
f850a067ed kompute : llama-bench support and ggml_cpu_has_kompute() (llama/5226) Jared Van Bortel 2024-01-30 19:04:37 -05:00
f75e1197f1 ggml : add abort_callback for cpu backend (ggml/725) Michael Podvitskiy 2024-02-09 10:42:27 +01:00
aa8a75e287 extra : update sync scripts Georgi Gerganov 2024-02-10 09:55:19 +02:00
80e8a2ea39 server : allow CORS request with authorization headers (#1850) Valentin Gosu 2024-02-09 16:42:41 +01:00
19f8048139 whisper.android : how to build with CLBlast (#1809) Neuman Vong 2024-02-10 02:39:05 +11:00
0f80e5a80a whisper : expose CUDA device setting in public API (#1840) Didzis Gosko 2024-02-09 17:27:47 +02:00
b6559333ff make : add macOS deployment target option (#1839) Didzis Gosko 2024-02-09 17:26:29 +02:00
434b8f3b96 talk-llama : stream response (#1121) Georgi Gerganov 2024-02-06 19:56:12 +02:00
7a74e929c8 sync : ggml (#0) Georgi Gerganov 2024-01-30 21:30:26 +02:00
361ecebe90 ggml : fix IQ3_XXS on Metal (llama/5219) Kawrakow 2024-01-30 19:15:28 +02:00
807cbc672e sync : ggml (llama/0) Georgi Gerganov 2024-01-30 16:21:57 +02:00
98ae5276b7 Faster AVX2 dot product for IQ2_XS (llama/5187) Kawrakow 2024-01-30 15:15:07 +02:00
6adb969b09 SOTA 3-bit quants (llama/5196) Kawrakow 2024-01-30 15:14:12 +02:00
8a7d6ff51a ggml alloc: Fix for null dereference on alloc failure (llama/5200) Paul Tsochantaris 2024-01-29 22:19:29 +00:00
25f650a8e8 Nomic Vulkan backend (llama/4456) Jared Van Bortel 2024-01-29 15:50:50 -05:00
44e517f074 ggml : add max buffer sizes to opencl and metal backends (llama/5181) slaren 2024-01-29 09:05:13 +01:00
cb9de61659 metal : free metal objects (llama/5161) Paul Tsochantaris 2024-01-28 19:50:16 +00:00
a2ef80d66f gguf : fix comparison (ggml/715) Georgi Gerganov 2024-01-29 21:08:18 +02:00
baa190446a ggml_cuda_cpy support for 4d tensors and float16->float32 upcasting (ggml/686) John Balis 2024-01-29 06:37:33 -06:00
8f5220d81f gguf : add input validation, prevent integer overflows (ggml/709) Georgi Gerganov 2024-01-29 14:00:10 +02:00
8e391fcf3a ci : fix yolo URLs + fix metal capture (ggml/712) Georgi Gerganov 2024-01-29 13:29:46 +02:00
593657054e metal : add debug capture backend function (ggml/694) Jack Mousseau 2024-01-29 01:22:23 -08:00
ae5c4f7340 common : fix wav buffer detection (#1819) JacobLinCool 2024-01-31 01:35:08 +08:00
baa30bacdb server : add fields to verbose_json response (#1802) JacobLinCool 2024-01-30 20:15:55 +08:00
3e6fad07aa make : update MSYS_NT (#1813) jwijffels 2024-01-30 13:13:49 +01:00
e72e4158de talk-llama : sync llama.cpp Georgi Gerganov 2024-01-28 19:44:10 +02:00
bd41733db2 sync : ggml Georgi Gerganov 2024-01-28 19:30:32 +02:00
23c648e98d ggml : add Vulkan backend (llama/2059) 0cc4m 2024-01-28 18:03:59 +01:00
75ab2d06f5 ggml : add unified SYCL backend for Intel GPUs (llama/2690) Abhilash Majumder 2024-01-28 21:26:23 +05:30
adc099edee ggml : minor type fix (int64_t -> size_t) Georgi Gerganov 2024-01-28 18:44:58 +02:00
52cce82493 common : fix input buffer check (#1812) Georgi Gerganov 2024-01-27 17:33:09 +02:00
ef3c9ed9eb talk-llama : sync llama.cpp Georgi Gerganov 2024-01-27 17:24:53 +02:00
7fe3ed5e00 sync : ggml Georgi Gerganov 2024-01-27 17:23:25 +02:00
6061241292 Add OpenCL add kernel (llama/5151) 0cc4m 2024-01-26 23:07:32 +01:00
0878ab7c15 cuda : fix tensor size calculation for non-split buffer (llama/5145) slaren 2024-01-26 18:59:43 +01:00
c65edd5b64 ggml-alloc : add 10% margin to the buffer sizes (llama/5149) slaren 2024-01-26 18:18:26 +01:00
3c8d14e9c5 ggml : update softmax n_task calculation (llama/5126) snadampal 2024-01-26 11:17:59 -06:00
c3977cb2ce metal : remove unused n_buffers and buffers (llama/5129) Paul Tsochantaris 2024-01-26 12:16:07 +00:00
6da1661bc2 metal : show compile log messages Georgi Gerganov 2024-01-25 11:26:17 +02:00
cc56540661 cuda : fix 2-bit quants on amd hip (llama/5105) Engininja2 2024-01-24 16:18:15 -06:00
94c1ae8668 llama : pre-allocate input tensors in a separate buffer (llama/5100) slaren 2024-01-24 12:48:14 +01:00
55d54359e0 metal : disable support for MUL_MAT F32 x F16 Georgi Gerganov 2024-01-23 15:50:56 +02:00
d33c2ad354 CUDA: more info when no device code (llama/5088) Johannes Gäßler 2024-01-23 13:31:56 +01:00
9afa7ff624 minor : clean-up some warnings and style (llama/5094) Georgi Gerganov 2024-01-23 14:12:57 +02:00
0649289f02 ggml : parallelize FP32 conversion when using BLAS (llama/5045) Reinforce-II 2024-01-22 21:15:08 +08:00
aaeaa43878 llava : MobileVLM support (llama/4954) XiaotaoChen 2024-01-22 21:09:35 +08:00
078b8e23bf llama : run all KQV ops on the CPU with no KV offload (llama/5049) slaren 2024-01-20 16:05:49 +01:00
74da3e1757 cuda : fix compile error in jetson platform (llama/4975) Kylin 2024-01-20 15:01:46 +08:00
2d2c93a798 ggml : check ggml_add src1 type (ggml/708) Judd 2024-01-26 21:04:01 +08:00
4bbb60efce docs : make model options / model install methods clearer (#1806) Michael Rienstra 2024-01-26 07:39:54 -08:00
1cf679dec4 cmake : make libwhisper.so position independent (#1792) trixirt 2024-01-22 05:02:35 -08:00
41026c1e4b cmake : temporary remove VLA check (#1795) Georgi Gerganov 2024-01-22 14:51:42 +02:00
d6b9be21d7 whisper.android : return output from benchmarks (#1785) Neuman Vong 2024-01-20 01:17:38 +11:00
c0329acde8 server : implement "verbose_json" format with token details (#1781) Ryan Hitchman 2024-01-18 13:58:42 -07:00
fb466b3417 ggml : sync ggml-metal.m Georgi Gerganov 2024-01-18 11:03:13 +02:00
1f50a7d29f sync : llama.cpp Georgi Gerganov 2024-01-17 21:23:33 +02:00
1de21b913d sync : ggml Georgi Gerganov 2024-01-17 21:22:38 +02:00
4aea058e5a ggml : add IQ2 to test-backend-ops + refactoring (llama/4990) Georgi Gerganov 2024-01-17 18:54:56 +02:00
fd10234363 imatrix : offload to GPU support (llama/4957) Georgi Gerganov 2024-01-17 18:46:30 +02:00
8fb5c6a409 backend : add eval callback (llama/4935) Georgi Gerganov 2024-01-17 18:39:41 +02:00
2fe5fbfcc2 metal : create autorelease pool during library build (llama/4970) Georgi Gerganov 2024-01-17 18:38:39 +02:00
01637e1a4c ggml : importance matrix support for legacy quants (llama/4969) Kawrakow 2024-01-16 19:51:26 +02:00
1b349eb1f9 metal : log recommendedMaxWorkingSetSize on iOS 16+ (llama/4936) Alex Azarov 2024-01-16 14:33:02 +01:00
138eaebead ggml : introduce GGML_CALL function annotation (llama/4850) Justine Tunney 2024-01-16 03:16:33 -08:00
61b9192f27 cuda : fix dequantize kernel names (llama/4938) Georgi Gerganov 2024-01-15 13:27:00 +02:00

... 39 40 41 42 43 ...