Sign up today for free — no credit card down.Get started
    All five industries

    HVAC & plumbing services

    Tolvanrie Heating & Plumbing

    Reno, NV

    A pile of small counter receipts, refrigerant tracked by the cylinder and fleet fuel on one consolidated statement.

    documents sent
    112documents sent
    vendors
    11vendors
    document layouts
    11document layouts
    carry a deliberate trap
    31carry a deliberate trap

    The setup

    An invented Reno business, built down to the chart of accounts

    The company and its vendors are made up. It still has its own QuickBooks company, its own local sales tax, and documents written the way this trade writes them.

    Its own QuickBooks company

    68accounts in a chart
    built for this trade
    Local sales tax on vendor documents
    8.265%
    Submission
    Automatic
    Inbox
    Its own email address, connected to DocStreamAI

    Nobody approved or corrected anything along the way. A document one of DocStreamAI's checks held for review stayed held, so every result is exactly what was read.

    Who sends the paperwork

    11 vendors in 8 trades, writing on 11 different layouts.

    From

    HVAC wholesalers

    To: Tolvanrie Heating & Plumbing

    From

    Plumbing wholesalers

    To: Tolvanrie Heating & Plumbing

    From

    Refrigerant & gas

    To: Tolvanrie Heating & Plumbing

    From

    Tool suppliers

    To: Tolvanrie Heating & Plumbing

    From

    Fleet fuel cards

    To: Tolvanrie Heating & Plumbing

    From

    Uniform & linen

    To: Tolvanrie Heating & Plumbing

    From

    Dispatch software

    To: Tolvanrie Heating & Plumbing

    From

    Backflow testing

    To: Tolvanrie Heating & Plumbing

    The pile

    Everything that arrived, one sheet per document

    57

    Invoices

    40

    Receipts

    10

    Credit memos

    5

    Vendor statements

    112 documents in 109 PDF files. The 5 vendor statements list invoices that were also sent, so the right number of new bills from them is zero.

    38% arrived as paper

    43 of 112 were scanned, photographed, faxed or photocopied. 69 were clean files.

    Scans
    29
    Phone photos
    10
    Faxes
    2
    Photocopies
    2

    The traps

    Where this paperwork goes wrong

    Technicians buy at the counter several times a week, so the pile is mostly small card receipts rather than bills on terms. Refrigerant is tracked by cylinder, and fleet fuel arrives as one consolidated statement.

    Counter sale · will call
    PEX 1/2 in, 100 ft64.95
    Crimp rings, bag of 5018.40
    Subtotal83.35
    Sales tax included6.36
    Total83.35

    Tax already inside the lines

    The receipt prints the tax for information only. The total equals the subtotal, and adding tax on top overstates the expense.

    Invoice · refrigerant and gas
    R-410A, 25 lb cylinder2 @ 342.00
    Serial 0471-22, 0471-23
    Line total684.00

    Refrigerant by the cylinder

    Each cylinder carries its own serial number and weight, so one line on the page is really an inventory record.

    Fleet fuel statement
    Van 04 · 6 fills412.18
    Van 07 · 5 fills366.90
    Van 11 · 7 fills488.25
    Statement total1,267.33

    One statement for the whole fleet

    Fuel for every van arrives as a single consolidated statement with a line per vehicle.

    RX 09/14 07:52 · P. 1/1
    Credit memo · HVAC wholesale
    Capacitor 45/5 MFD, warranty(56.82)
    Credit total(56.82)

    Negatives in parentheses

    A warranty return written as (56.82). Drop the parentheses and a credit becomes a charge.

    Excerpts drawn in the shape of this industry's documents, with invented names. The full set carries 18 kinds of difficulty across all five businesses. See every one

    The results

    How DocStreamAI handled this inbox

    Measured in two places. Inside DocStreamAI: what was read, what kind of document it is, whether it made it from the email, which vendor it belongs to and where it was categorized, each checked against the answer key written for every document. Then in QuickBooks: whether the record that landed matches.

    55 text PDFs from Tolvanrie Heating & Plumbing, the kind billing software makes. 53 reached extraction and were scored against their answer keys.

    97.0%668 of 689

    Extraction

    Values read correctly off the page, every field pooled.

    84.9%45 of 53

    Every key field right*

    Documents with every key field correct at once.

    96.2%51 of 53

    Detection

    Invoice, receipt or credit memo, identified correctly.

    96.4%53 of 55

    Intake

    Documents that made it from the email to a record DocStreamAI read.

    Vendor statements kept out: 5 of 5

    96.0%48 of 50

    Vendor

    Read after the vendor was in QuickBooks, and found it. How this is counted is on the summary page.

    Not measured yet

    Categorization

    Expense account matches the account the chart intends.

    * Line descriptions, quantities and unit prices count as lower severity and are left out of this figure. QuickBooks records each line by its amount, so a wrong quantity or unit price does not change what lands in the books. Counting them too: 81.1% (43 of 53).

    Extraction, field by field

    Vendor name

    100.0%

    53 of 53 read correctly

    Document number

    100.0%

    53 of 53 read correctly

    Document date

    94.3%

    50 of 53 read correctly

    Due date

    94.3%

    50 of 53 read correctly

    Currency

    100.0%

    53 of 53 read correctly

    Subtotal

    100.0%

    53 of 53 read correctly

    Tax

    100.0%

    53 of 53 read correctly

    Total

    96.2%

    51 of 53 read correctly

    Number of lines

    96.2%

    51 of 53 read correctly

    Line descriptionsLower severity

    94.3%

    50 of 53 read correctly

    Line quantitiesLower severity

    94.3%

    50 of 53 read correctly

    Unit pricesLower severity

    94.3%

    50 of 53 read correctly

    Line amounts

    96.2%

    51 of 53 read correctly

    Scanned PDFs

    Scans, phone photos and faxes, on their own

    Reported apart from text PDFs because one part of handling them is still being built.

    37 scanned PDFs sent: office scans, phone photos, faxes and photocopies saved as PDF. 33 reached extraction and were scored.

    Once a scan is read

    • 94.6%406 of 429

      Fields read correctly

    • 90.9%30 of 33

      Every key field right*

    • 100.0%33 of 33

      Type detected

    Text PDFs, for comparison: 97.0% of fields read correctly, and every key field right* on 84.9% of documents.

    Getting a scan to that point

    The only attachment on its email

    33 of 33

    Picked up and read every time.

    Sent with other attachments

    0 of 4

    Not picked up yet. The other attachments on the same email were read as normal.

    Scanned vendor statements kept out

    0 of 0

    Not recognised as statements yet. 0 of the 0 were posted as bills.

    Planned for a future update: picking up scanned PDFs that arrive alongside other attachments, and recognising a scanned vendor statement for what it is.

    * Line descriptions, quantities and unit prices count as lower severity and are left out of this figure. QuickBooks records each line by its amount, so a wrong quantity or unit price does not change what lands in the books. Counting them too: 72.7% (24 of 33).

    In QuickBooks

    What landed in the books

    The record in QuickBooks matches the document and what DocStreamAI read, per record type.

    • Not measured yet

      Bills

      Created from invoices.

      Not measured in this run.

    • Not measured yet

      Vendor credits

      Created from credit memos.

      Not measured in this run.

    • Not measured yet

      Expenses

      Created from receipts.

      Waiting on the card match. A receipt posts once its payment card is matched to an account in QuickBooks, and that is not set up in these companies yet.

    The other four businesses

    Summary of all five

    Roofing & exterior contracting

    Kestovane Ridge Roofing

    Sacramento, CA

    Restaurant group

    Fennick & Thorlow Restaurant Group

    San Francisco, CA

    Marketing & creative agency

    Wendlemarsh Creative Studio

    Chicago, IL

    E-commerce & import

    Amblequist Row Home Goods

    Portland, OR