Create Haystack and Langchain Nodes

[bsuryadevara]

Description

Closes

By Submitting this PR I confirm:

• I am familiar with the Contributing Guidelines.
• When the PR is ready for review, new or existing tests cover these changes.
• When the PR is ready for review, the documentation is up to date with these changes.

[bsuryadevara]

@mdemoret-nv I have attempted to incorporate Haystack agents into a simple pipeline, and there are a few crucial points I'd like to bring to your attention. Additionally, I'd like to confirm whether we want to proceed with this approach before drafting comparison tests.

1. Haystack have neither pre-built tools (unlike langchain) nor examples that shows how to implement custom tools.
2. Calculator tool is not available.
3. Results are varying for every run and it does work only with SERPDEV_API_KEY, but not SERPAPI_API_KEY
4. Haystack 2.0 (Future release) will have lot of breaking API changes.

If don't add the custom calculator tool, I keep getting Calculator tool missing error. However adding custom tool is not giving expected results for all runs.

Exception occurred in pipeline. Rethrowing
Traceback (most recent call last):
  File "/home/bsuryadevara/Github/morpheus/morpheus/pipeline/pipeline.py", line 419, in join
    await executor.join_async()
  File "/home/bsuryadevara/mambaforge/envs/morpheus/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/home/bsuryadevara/mambaforge/envs/morpheus/lib/python3.10/asyncio/tasks.py", line 650, in _wrap_awaitable
    return (yield from awaitable.__await__())
  File "/home/bsuryadevara/Github/morpheus/morpheus/llm/nodes/haystack_agent_node.py", line 70, in execute
    results = await self._run_single(**input_dict)
  File "/home/bsuryadevara/Github/morpheus/morpheus/llm/nodes/haystack_agent_node.py", line 59, in _run_single
    results = await asyncio.gather(*tasks)
  File "/home/bsuryadevara/mambaforge/envs/morpheus/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/bsuryadevara/mambaforge/envs/morpheus/lib/python3.10/site-packages/haystack/agents/base.py", line 365, in run
    agent_step = self._step(query, agent_step, params)
  File "/home/bsuryadevara/mambaforge/envs/morpheus/lib/python3.10/site-packages/haystack/agents/base.py", line 381, in _step
    observation = self.tm.run_tool(next_step.prompt_node_response, params) if not next_step.is_last() else None
  File "/home/bsuryadevara/mambaforge/envs/morpheus/lib/python3.10/site-packages/haystack/agents/base.py", line 164, in run_tool
    tool: Tool = self.tools[tool_name]
KeyError: 'Calculator'

Run command:

python examples/llm/main.py agents simple --llm_orch haystack

[mdemoret-nv]

I need to look more closely at the calculator to see if there are better options

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[bsuryadevara]

Including LlamaIndex functionality in this PR

[bsuryadevara]

Noticed below dependencies version updates when installing cuda11.8_examples.yml

I'm able to run all LLM tests on my local after applying cuda11.8_examples.yml, but CI is failing with module not found errors (openai, haystack).

[bsuryadevara]

/ok to test

[bsuryadevara]

/ok to test

[bsuryadevara]

/ok to test