BigQuery & Tavily FastAPI MCP

BigQuery & Tavily FastAPI MCP

By osushinekotan GitHub

bigquery & web search api + mcp server

bigquery fastapi
Overview

What is BigQuery & Tavily FastAPI MCP?

BigQuery & Tavily FastAPI MCP is a lightweight and secure API designed for accessing and querying Google BigQuery datasets and Tavily search functionalities.

How to use BigQuery & Tavily FastAPI MCP?

To use this project, clone the repository, install the necessary dependencies, configure your environment variables, and run the application. The API will be accessible at http://localhost:8000.

Key features of BigQuery & Tavily FastAPI MCP?

  • Read-only access to BigQuery datasets and tables.
  • Security features including query validation and dataset access control.
  • Full support for standard BigQuery queries with cost control.
  • Tavily search and web content extraction capabilities.
  • RESTful API with comprehensive documentation.

Use cases of BigQuery & Tavily FastAPI MCP?

  1. Querying and analyzing large datasets in Google BigQuery.
  2. Extracting web content using Tavily for data enrichment.
  3. Integrating with other applications via a secure API.

FAQ from BigQuery & Tavily FastAPI MCP?

  • What are the prerequisites for using this API?

You need Python 3.11 or higher, a Google Cloud Project with BigQuery enabled, and a Tavily API key.

  • Is there a cost associated with using BigQuery?

Yes, BigQuery charges based on the amount of data processed by your queries.

  • Can I use this API for production applications?

Yes, it is designed to be secure and efficient for production use.

Content

BigQuery & Tavily FastAPI MCP

A lightweight, secure API & MCP for accessing and querying Google BigQuery datasets and Tavily search

FastAPI

Features

  • Read-only access to BigQuery datasets and tables
  • Security features including query validation and dataset access control
  • Full support for standard BigQuery queries with cost control
  • Tavily search and web content extraction capabilities
  • RESTful API with comprehensive documentation

Setup

Prerequisites

  • Python 3.11 or higher
  • Google Cloud Project with BigQuery enabled
  • Service account with BigQuery access
  • Tavily API key for search functionality

Installation

  1. Clone the repository
git clone https://github.com/osushinekotan/bigquery-fastapi-mcp
cd bigquery-fastapi-mcp
  1. Install dependencies
uv sync
  1. Create a .env file with your configuration
BQ_PROJECT_ID=your-gcp-project-id
BQ_ALLOWED_DATASETS=dataset1,dataset2,dataset3
BQ_MAX_BYTES_BILLED=1073741824  # 1GB default
TAVILY_API_KEY=your-tavily-api-key
APP_HOST=127.0.0.1
APP_PORT=8000
  1. Set up GCP authentication
# Either set the environment variable
export GOOGLE_APPLICATION_CREDENTIALS=/path/to/your/service-account-key.json

# Or authenticate using gcloud
gcloud auth application-default login

Running the Application

uv run uvicorn app.main:app --reload

or

uv run python -m app.main

The API will be available at http://localhost:8000

API documentation will be available at http://localhost:8000/docs

API Endpoints

Health Check

  • GET /health/health - Verify the API is running

BigQuery Datasets

  • GET /bigquery/list_datasets - List all datasets in the project (filtered by allowed datasets)
  • GET /bigquery/allowed_datasets - Get configured allowed datasets

BigQuery Tables

  • GET /bigquery/tables - List all tables in allowed datasets
  • GET /bigquery/tables?dataset_id=your_dataset - List tables in a specific dataset
  • GET /bigquery/tables/{dataset_id}/{table_id} - Get detailed information about a specific table

BigQuery Query

  • POST /bigquery/query - Execute a BigQuery query

Example request body:

{
  "query": "SELECT * FROM `project.dataset.table` LIMIT 10",
  "dry_run": true
}
  • POST /search/search - Search the web using Tavily

Example request body:

{
  "query": "latest developments in AI",
  "max_results": 5
}

Tavily Extract

  • POST /search/extract - Extract content from web URLs

Example request body:

{
  "urls": ["https://example.com/article1", "https://example.com/article2"]
}

Security Features

  • Read-only query validation (only SELECT statements are allowed)
  • Dataset access control through environment configuration
  • Maximum billable bytes limit with configurable thresholds

MCP server

https://github.com/tadata-org/fastapi_mcp

Connecting to the MCP Server using SSE

Once your FastAPI app with MCP integration is running, you can connect to it with any MCP client supporting SSE, such as Cursor:

  1. Run your application.

  2. In Cursor -> Settings -> MCP, use the URL of your MCP server endpoint (e.g., http://localhost:8000/mcp) as sse.

  3. Cursor will discover all available tools and resources automatically.

Connecting to the MCP Server using mcp-proxy stdio

If your MCP client does not support SSE, for example Claude Desktop:

  1. Run your application.

  2. Install mcp-proxy, for example: uv tool install mcp-proxy.

  3. Add in Claude Desktop MCP config file (claude_desktop_config.json):

On Windows:

{
  "mcpServers": {
    "my-api-mcp-proxy": {
      "command": "mcp-proxy",
      "args": ["http://127.0.0.1:8000/mcp"]
    }
  }
}

On MacOS:

Find the path to mcp-proxy by running in Terminal: which mcp-proxy.

{
  "mcpServers": {
    "my-api-mcp-proxy": {
      "command": "/Full/Path/To/Your/Executable/mcp-proxy",
      "args": ["http://127.0.0.1:8000/mcp"]
    }
  }
}

Find the path to mcp-proxy by running in Terminal: which uvx.

{
  "mcpServers": {
    "my-api-mcp-proxy": {
      "command": "/Full/Path/To/Your/uvx",
      "args": ["mcp-proxy", "http://127.0.0.1:8000/mcp"]
    }
  }
}
  1. Claude Desktop will discover all available tools and resources automatically
No tools information available.

Mirror of

bigquery mcp-server
View Details

Real-time stock API with Python, MCP server example, yfinance stock analysis dashboard

python fastapi
View Details

A Model Context Protocol (MCP) server that provides secure, read-only access to BigQuery datasets. Enables Large Language Models (LLMs) to safely query and analyze data through a standardized interface.

bigquery sql
View Details

Mirror of

bigquery llm
View Details
BigQuery
BigQuery by LucasHild

(by LucasHild) - This server enables LLMs to inspect database schemas and execute queries on BigQuery.

bigquery database-querying
View Details