Marketing & creative agency
Chicago, IL
Ad platforms bill in round threshold charges with no invoice number, and freelancer invoices rarely share a template.
The setup
The company and its vendors are made up. It still has its own QuickBooks company, its own local sales tax, and documents written the way this trade writes them.
Its own QuickBooks company
Nobody approved or corrected anything along the way. A document one of DocStreamAI's checks held for review stayed held, so every result is exactly what was read.
14 vendors in 8 trades, writing on 9 different layouts.
From
Ad platforms
To: Wendlemarsh Creative Studio
From
SaaS subscriptions
To: Wendlemarsh Creative Studio
From
Cloud infrastructure
To: Wendlemarsh Creative Studio
From
Freelancers & contractors
To: Wendlemarsh Creative Studio
From
Photo & video production
To: Wendlemarsh Creative Studio
From
Print & fabrication
To: Wendlemarsh Creative Studio
From
Coworking
To: Wendlemarsh Creative Studio
From
Stock media
To: Wendlemarsh Creative Studio
The pile
Invoices
Receipts
Credit memos
Vendor statements
109 documents in 108 PDF files. The 5 vendor statements list invoices that were also sent, so the right number of new bills from them is zero.
39% arrived as paper
42 of 109 were scanned, photographed, faxed or photocopied. 67 were clean files.
The traps
Ad platforms charge the card whenever spend crosses a threshold, so the amounts land on exact round values, there is no invoice number, and several charges from the same vendor on the same day is normal. Freelancer invoices are the opposite, and they rarely share a template.
Three identical charges in one day
Spend crossed the threshold three times. Same vendor, same amount, same date, and all three are real.
Not in dollars
A freelancer bills in euros. The amount reads correctly and the money is still wrong without the currency.
Billed and due the same day
A subscription settles the day it is issued. It is not overdue and should not be chased.
The line total is not quantity times price
A volume tier the page never shows. The vendor billed 399.00, and recalculating restates the invoice.
Excerpts drawn in the shape of this industry's documents, with invented names. The full set carries 18 kinds of difficulty across all five businesses. See every one
The results
Measured in two places. Inside DocStreamAI: what was read, what kind of document it is, whether it made it from the email, which vendor it belongs to and where it was categorized, each checked against the answer key written for every document. Then in QuickBooks: whether the record that landed matches.
52 text PDFs from Wendlemarsh Creative Studio, the kind billing software makes. 51 reached extraction and were scored against their answer keys.
Extraction
Values read correctly off the page, every field pooled.
Every key field right*
Documents with every key field correct at once.
Detection
Invoice, receipt or credit memo, identified correctly.
Intake
Documents that made it from the email to a record DocStreamAI read.
Vendor statements kept out: 3 of 3
Vendor
Read after the vendor was in QuickBooks, and found it. How this is counted is on the summary page.
Categorization
Expense account matches the account the chart intends.
* Line descriptions, quantities and unit prices count as lower severity and are left out of this figure. QuickBooks records each line by its amount, so a wrong quantity or unit price does not change what lands in the books. Counting them too: 92.2% (47 of 51).
Extraction, field by field
Vendor name
100.0%
51 of 51 read correctly
Document number
100.0%
51 of 51 read correctly
Document date
100.0%
51 of 51 read correctly
Due date
100.0%
51 of 51 read correctly
Currency
100.0%
51 of 51 read correctly
Subtotal
96.1%
49 of 51 read correctly
Tax
100.0%
51 of 51 read correctly
Total
100.0%
51 of 51 read correctly
Number of lines
100.0%
51 of 51 read correctly
Line descriptionsLower severity
100.0%
51 of 51 read correctly
Line quantitiesLower severity
92.2%
47 of 51 read correctly
Unit pricesLower severity
92.2%
47 of 51 read correctly
Line amounts
100.0%
51 of 51 read correctly
Scanned PDFs
Scans, phone photos and faxes, on their own
Reported apart from text PDFs because one part of handling them is still being built.
33 scanned PDFs sent: office scans, phone photos, faxes and photocopies saved as PDF. 24 reached extraction and were scored.
Once a scan is read
Fields read correctly
Every key field right*
Type detected
Text PDFs, for comparison: 98.5% of fields read correctly, and every key field right* on 96.1% of documents.
Getting a scan to that point
The only attachment on its email
24 of 24
Picked up and read every time.
Sent with other attachments
0 of 9
Not picked up yet. The other attachments on the same email were read as normal.
Scanned vendor statements kept out
0 of 2
Not recognised as statements yet. 1 of the 2 were posted as bills.
Planned for a future update: picking up scanned PDFs that arrive alongside other attachments, and recognising a scanned vendor statement for what it is.
* Line descriptions, quantities and unit prices count as lower severity and are left out of this figure. QuickBooks records each line by its amount, so a wrong quantity or unit price does not change what lands in the books. Counting them too: 87.5% (21 of 24).
In QuickBooks
What landed in the books
The record in QuickBooks matches the document and what DocStreamAI read, per record type.
Created from invoices.
Not measured in this run.
Created from credit memos.
Not measured in this run.
Created from receipts.
Waiting on the card match. A receipt posts once its payment card is matched to an account in QuickBooks, and that is not set up in these companies yet.
We use analytics and advertising cookies to understand how visitors use the site and to measure our marketing. See our Privacy Policy.
