LangChainを勉強しよう Part1

from langchain.llms import LlamaCpp
from langchain import PromptTemplate

model_path = "./llama/llama-2-7b-chat.ggmlv3.q8_0.bin"
llm = LlamaCpp(
    model_path=model_path,
    temperature=0.7,
    max_tokens=2000,
    top_p=1,
    verbose=True
)

prompt_template = PromptTemplate.from_template(
    "Tell me a {adjective} joke about {content}."
)

prompt = prompt_template.format(adjective="funny", content="chickens")
result = llm(prompt)

print(result)

template = ChatPromptTemplate.from_messages([
    ("system", "You are a helpful AI bot. Your name is {name}."),
    ("human", "Hello, how are you doing?"),
    ("ai", "I'm doing well, thanks!"),
    ("human", "{user_input}"),
])

messages = template.format_messages(
    name="Bob",
    user_input="What is your name?"
)

//メッセージの中身
[SystemMessage(content='You are a helpful AI bot. Your name is Bob.', additional_kwargs={}),
 HumanMessage(content='Hello, how are you doing?', additional_kwargs={}, example=False),
 AIMessage(content="I'm doing well, thanks!", additional_kwargs={}, example=False),
 HumanMessage(content='What is your name?', additional_kwargs={}, example=False)

//実行
llm = ChatOpenAI()
llm(template.format_messages(text='What is your name?'))
//結果
AIMessage(content='My name is Bob. How can I assist you today?', additional_kwargs={}, example=False)

(公式Docのサンプルコードなので中略)
llm_text_llama = LlamaCpp(model_path='./llama/llama-2-7b-chat.ggmlv3.q8_0.bin')

llm_text_llama(prompt.format(input="Who was the father of Mary Ball Washington?"))

Are follow up questions needed here:Yes.
Follow up: What was the name of Mary Ball Washington's husband?
Intermediate answer: The husband of Mary Ball Washington was Joseph Ball.
So the final answer is: Joseph Ball

Question: Who was the director of

llm_text_llama("Who was the father of Mary Ball Washington?")

Mary Ball Washington, the mother of George Washington, was born in 1708 and died in 1789.
Her father's name is not definitively known, but there are several theories about his identity. 
Some historians believe that her father may have been Joseph Ball, a planter from Lancaster County, 
Virginia, while others suggest that he may have been George Eskridge, 
a prominent lawyer and politician from nearby King George County. 
Despite efforts to identify Mary Ball Washington's father with certainty, 
the mystery surrounding his identity remains unsolved.

examples=[
    {"country":"Japan","capital":"Tokyo"},
    {"country":"United States","capital":"Washington"}
]
example_prompt = PromptTemplate(input_variables=["country", "capital"], template="country:{country} => capital:{capital}")
prompt = FewShotPromptTemplate(
    examples=examples, 
    example_prompt=example_prompt, 
    suffix="country:{input}", 
    input_variables=["input"]
)

llm_text_llama(prompt.format(input="Korea"))

//結果

=> capital:Seoul
I hope this helps!

llm_text_llama("country:Japan => capital:Tokyo \n country: United States => capital:Washington \n country:Korea =>")

 capital:Seoul 
 country:Canada => capital:Ottawa 
 country: Australia => capital:Canberra 
 country:Germany => capital:Berlin 
 country:France => capital:Paris 
 country:Italy => capital:Rome 
 country:Spain => capital:Madrid 
 country:United Kingdom => capital:London 
 country:Switzerland => capital:Bern 
 country:Norway => capital:Oslo 
 country:Denmark => capital:Copenhagen 
 country:Finland => capital:Helsinki 
 country:Russia => capital:Moscow 
 country:China => capital:Beijing 
 country:India => capital:New Delhi 
 country:Brazil => capital:Brasília 
 country:South Africa => capital:Pretoria 
 country:Mexico => capital:Mexico City 
 country:Argentina => capital:Buenos Aires 
 country:Chile => capital:Santiago 
 country:Colombia => capital:Bogotá 
 country:Peru => capital: