Skip to content

Latest commit

 

History

History

README.md

Arbitration Post-Hearing Assistant

The Arbitration Post-Hearing Assistant is a GenAI-based module designed to process and summarize post-hearing transcripts or arbitration-related documents. It intelligently extracts key entities and insights to assist arbitrators, legal teams, and case managers in managing case follow-ups efficiently.

Table of contents

  1. Architecture
  2. Deployment Options

Architecture

The architecture of the ArbPostHearingAssistant Application is illustrated below:

Architecture

The ArbPostHearingAssistant example is implemented using the component-level microservices defined in GenAIComps.

Deployment Options

The table below lists currently available deployment options. They outline in detail the implementation of this example on selected hardware.

Category Deployment Option Description
On-premise Deployments Docker Compose (Xeon) ArbPostHearingAssistant deployment on Xeon
Docker Compose (Gaudi) ArbPostHearingAssistant deployment on Gaudi

Validated Configurations

Deploy Method LLM Engine LLM Model Hardware
Docker Compose vLLM, TGI mistralai/Mistral-7B-Instruct-v0.2 Intel Gaudi
Docker Compose vLLM, TGI mistralai/Mistral-7B-Instruct-v0.2 Intel Xeon