tiiuae
/

falcon-40b

Text Generation

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (40)

Keep getting 'model_kwargs` are not used by the model: ['token_type_ids']

#60 opened almost 2 years ago by

Falcon models slow inference

#59 opened almost 2 years ago by

I need an API of Falcon

#56 opened almost 2 years ago by

Google Colab for Falcon 40B and 7B with Live Response Streaming

#55 opened almost 2 years ago by

can anyone help me get prompt template for Question Answering model

#54 opened almost 2 years ago by

Iamexperimenting

Might be interesting to have a thread on people with Successful Implementations, and on what kind of hardware..

#53 opened almost 2 years ago by

Batch inference seems to be done sequentially

#50 opened almost 2 years ago by

Extracting attention maps

#49 opened almost 2 years ago by

Error with custom inference loop with past_key_values

#48 opened almost 2 years ago by

Fix the kv-cache dimensions

#47 opened almost 2 years ago by

Multi GPU inference issue

#39 opened almost 2 years ago by

Is it on purpose? loss for singlelable and multilable switched.

#36 opened almost 2 years ago by

Fine-tuning on a new language

#35 opened almost 2 years ago by

Flash attention

#34 opened almost 2 years ago by

about evaluating on humaneval

#33 opened almost 2 years ago by

Finetune on "uncensored" dataset?

#32 opened almost 2 years ago by

Tokenizer Details

#31 opened almost 2 years ago by

Import dataset and chat with it

#27 opened almost 2 years ago by

Working code with full server requirements

#24 opened almost 2 years ago by

Bug: Generate method doesn't work for falcon-7b and falcon-40b in int8 mode.

#22 opened almost 2 years ago by

It can run with two 4090 or a single 6000 ADA.

#20 opened almost 2 years ago by

请求：DOI

#16 opened almost 2 years ago by

Finetune wtih QLoRA please

#14 opened almost 2 years ago by

How to set trust_remote_code to true?

#9 opened almost 2 years ago by

[Bug] Does not work

#3 opened almost 2 years ago by