Considerations for optimum performance
Review the considerations to capture the performance metrics of IQ Bot standard forms with a new Model containing more number of forms or table fields.
- Performance test was run for 10000 COVID Form documents (two pages per document = 20000 pages) on a single node IQ Bot server using a single Bot Agent (using IQ Bot Extraction package). This test was conducted to benchmark the performance metrics such as processing time, Straight Through Processing (STP), validation, and documents processed (#successful processed pages/documents and #failed pages/documents).
- New Model (WalgreenComplete 3260b299-68b5-4118-87df-b313bd5c30f6) with 26 Form Fields & 8 Tables fields are trained and used for extraction.
- With new Model (WalgreenComplete 3260b299-68b5-4118-87df-b313bd5c30f6), all the documents were moving to validation during extraction. To get STP we marked below 5 fields as optional for this test: A2PatientSign, B2Date, B2Sign, Phone, InsuranceCard(Table)->Card Details.
- Total time take to process 20000 pages using single Bot Agent was 25 hours, 21 minutes, & 42 seconds. This was based on IQ Bot On-Premises Build 12350.
- Average time take to process single page using IQ Bot Extraction package on single Bot Agent is approximate 4.56 seconds.
- Achieved STP: 100% and Accuracy: 100%.
- During our test execution, the requests were served by Microsoft standard forms services hosted in us-west2 region.
- As confirmed, Microsoft team TPS (Transactions Per Second) supported by us-west2 region was 100 TPS
|Server 1 [Web Server]||Control Room||Windows Server 2019 → 8vCPU, 16 GB RAM, 512 GB Disk [Rackspace Platform]-uee|
|Server 2 [Database]||Database||Windows Server 2019 → 8vCPU, 16 GB RAM, 512 GB Disk [Rackspace Platform]|
|Server 3 [Application Server]||IQ Bot||Windows Server 2019 → 8vCPU, 16 GB RAM, 512 GB Disk [Rackspace Platform]|
|Server 4 [Client]||Bot Agent||Windows Server 2019 → 4vCPU, 8 GB RAM, 256 GB Disk [Rackspace Platform]|
|Automation Anywhere Enterprise||Automation 360 Build 12313|
|IQ Bot Extraction package||1.0.0-20220307-024320|
|Database||Microsoft SQL Server Developer (64-bit)|
|Network services||Non-Active Directory|
|Provider||Forms Extractor Type 1|
|Document Type||Multi page PDF document|
|Pages||Two pages per document|
[A2Date, A2PatientSign, Address, Age, B2Date, B2Sign, City, DOB, Email, FirstName, LTCFName, LastName, Phone, PrintName, Race-American, Race-Asian, Race-Black, Race-Native, Race-Other, Race-UnableToReport, Race-Unknown, Race-White, RefusedInformation, State, VaccinationType, Zipcode]
|Table Fields||8 tables, 23 table fields
Table1: DriversLicense[Issuance, LicenseNo]Table2: Ethnicity[Hispanic, NotHispanic, UnableToReport, Unknown]Table3: Gender[Female, Male]Table4: InsuranceCard[Card Details, Medical Card, Pharmacy Card]Table5: MedicareDetails[Medicare, Medicare PartB]Table6: PatientCardHolder[DontKnow, No, Question, Yes]Table7: PatientType[Resident, StaffMember]Table8: ScreeningQuestions[DontKnow, No, Question, Yes]
|# of Documents||10000|
|# of Pages||20000|
|Total Documents Uploaded||10000|
|Total Pages Uploaded||20000|
|Total Processed documents||10000|
|Total Processed pages||20000|