Google MakerSuite
Google's MakerSuite is a web-based playground for creating and saving chat, text, and "data" prompts that work with the Google PaLM API and model. These prompts include the text, which may include "test input" that act as template parameters, and parameters for the model including the model name, temperature, etc.
LangChain.js provides the MakerSuiteHub
class which lets you pull this prompt
from Google Drive, where they are saved. Once pulled, you can convert the prompt
into a LangChain Template, an LLM Model, or a chain that combines the two. This
hub class has a simple time-based in-memory cache of prompts, so it is not always
accessing the prompt saved in Google Drive.
Using MakerSuite in this way allows you to treat it as a simple Content Management System (CMS) of sorts or allows separation of tasks between prompt authors and other developers.
Setup
You do not need any additional packages beyond those that are required for either the Google PaLM text or chat model:
- npm
- Yarn
- pnpm
npm install google-auth-library @google-ai/generativelanguage
yarn add google-auth-library @google-ai/generativelanguage
pnpm add google-auth-library @google-ai/generativelanguage
Credentials and Authorization
You will need two sets of credentials:
An API Key to access the PaLM API.
Create this at Google MakerSuite. Then set the key as
GOOGLE_PALM_API_KEY
environment variable.Credentials for a service account that has been permitted access to the Google Drive APIs.
These credentials may be used in one of three ways:
- You are logged into an account (using
gcloud auth application-default login
) permitted to that project. - You are running on a machine using a service account that is permitted to the project.
- You have downloaded the credentials for a service account that is permitted
to the project and set the
GOOGLE_APPLICATION_CREDENTIALS
environment variable to the path of this file.
- You are logged into an account (using
This service account should also be permitted to the MakerSuite folder in Google Drive or to the specific prompt file itself. Even if the prompt file is permitted for anyone to read - you will still need a service account that is permitted to access Google Drive.
The Prompt File ID
The easiest way to get the ID of the prompt file is to open it in MakerSuite and examine the URL. The URL should look something like:
https://makersuite.google.com/app/prompts/1gxLasQIeQdwR4wxtV_nb93b_g9f0GaMm
The final portion of this, 1gxLasQIeQdwR4wxtV_nb93b_g9f0GaMm
is the ID.
We will be using this in our examples below. This prompt contains a Template that is equivalent to:
What would be a good name for a company that makes {product}
With model parameters set that include:
- Model name: Text Bison
- Temperature: 0.7
- Max outputs: 1
- Standard safety settings
Use
The most typical way to use the hub consists of two parts:
- Creating the
MakerSuiteHub
class once. - Pulling the prompt, getting the chain, and providing values for the template to get the result.
// Create the hub class
import { MakerSuiteHub } from "langchain/experimental/hubs/makersuite/googlemakersuitehub";
const hub = new MakerSuiteHub();
// Pull the prompt, get the chain, and invoke it with the template values
const prompt = await hub.pull("1gxLasQIeQdwR4wxtV_nb93b_g9f0GaMm");
const result = await prompt.toChain().invoke({ product: "socks" });
console.log("text chain result", result);
Configuring the hub
Since the hub implements a basic in-memory time-based cache, you can configure how long until a prompt that is saved in the cache will be reloaded.
This value defaults to 0, indicating it will always be loaded from Google Drive, or you can set it to the number of milliseconds it will be valid in the cache:
const hub = new MakerSuiteHub({
cacheTimeout: 3600000, // One hour
});
Getting the Template or Model
In some cases, you may need to get just the template or just the model that is represented by the prompt.
const template = prompt.toTemplate();
const textModel = prompt.toModel() as GooglePaLM;
const chatModel = prompt.toModel() as ChatGooglePaLM;