README.md

---
library_name: transformers
tags:
- sql-generation
- falcon
- lora
- rag
- transformers
- text-to-sql
---

# Model Card for Falcon SQL Generator (LoRA Fine-Tuned)

A lightweight Falcon-1B model fine-tuned using LoRA on Spider-style SQL generation examples. The model takes in a user query and schema context and generates corresponding SQL queries. It supports few-shot prompting and can be integrated with retrieval-based systems.

## Model Details

### Model Description

This model is a fine-tuned version of `tiiuae/falcon-rw-1b` using Parameter-Efficient Fine-Tuning (LoRA) for the **text-to-SQL task**. It is trained on custom Spider-style examples that map natural language questions to valid SQL queries over a provided schema context.

- **Developed by:** revanth kumar
- **Finetuned by:**  revanth kumar
- **Model type:** Causal Language Model (AutoModelForCausalLM)
- **Language(s):** English (NL input) and SQL (output)
- **License:** Apache 2.0 (inherits from base Falcon model)
- **Finetuned from:** [tiiuae/falcon-rw-1b](https://huggingface.co/tiiuae/falcon-rw-1b)

### Model Sources

- **Repository:** [https://huggingface.co/nandini2455508/falcon-sql-lora](https://huggingface.co/nandini2455508/falcon-sql-lora)

## Uses

### Direct Use

This model can be directly used for **natural language to SQL generation**. It supports queries like:

```text
"List all employees earning more than 50000"
→ SELECT * FROM employees WHERE salary > 50000;