Shipment Intelligence
Why is Shipment Intelligence relevant?
The Shipment Intelligence solution from A-INSIGHTS provides insights into international trade. Through extensive cleansing and mapping the Bill of Lading is no longer just a shipping document, it captures intricate details of the shipment lifecycle. Dive deeper than just statistics: gain insights in supplying & importing companies, the price dynamics per player and a unique product split.
Types explained
Customs: means data is provided by customs of that country and we have full data of its trade. For example, India makes its data available directly for all shipments by road, sea, and air so it includes data of all importers in India.
Mirror: refers to additional Bill of Lading data and customs records given by trade partners. Additional Bill of Lading data is provided by sources other than customs.
Additional note: Some countries take a long time to update or complete their data (such as Moldova, Morocco, etc.). Also, additional B/L data is not provided on a regular basis. Since data of mirror countries is based on its trade partners’ data and additional B/L data, number of shipments for each month may change during the year. We upload all data collected from different sources to a single database. When you search for a country with any search criteria on our platform, you see all data available in our database at that time. For example, in data of the last year, there is additional B/L data which has not been updated for this year yet.
Dual vendor strategy
To come to the best end result possible, we at A-INSIGHTS use a dual vendor strategy. This means that, we combine the input of different sources to get to the best data. In this case:
DataSur = US Imports and Argentina Exports
TradeAtlas = 73 other countries
Cleaning step - Product cleaning and deepening
Bill of Lading data is very unstructured and messy (e.g. a lot of typos, wrong HS classifications and unrevealed potential for more detailed splits). To make it actionable, an extensive product mapping approach is used, consisting of both automated and manual steps. To highlight the most important ones:
Filter out irrelevant shipments incorrectly categorized under a certain HS – too often it happens that shipments that doesn’t have anything to do with the labelled HS code end up it the wrong category. Not correcting for this will have an impact on data quality and misconceptions about trade volumes and values
Deepening Product classification – based on more than 1,000+ mappings dividing the HS Code 200410 (Frozen Potato Products) into Frozen French Fries, Frozen Potato Specialties and Other
Cleaning step - Harmonizing exporters & importers
Taking an unique multi step approach, covering in total more than 40,000+ mappings to get to a cleaned list of exporters and importers. This multi-step cleaning process involves cleaning based on:
Exporter and Importer names mentioned in product descriptions
Brands of exporters or importers mentioned in branding columns
Notify party for importers to get the end customer in scope instead of the logistic partner
Derive exporter and importer based on the combination of port of origin or departure and country of arrival
Cleaning step - Normalizing weights and values
Dense process consisting of multiple steps (presented in the order of processing)
Cleaning unit of mass (e.g. kilogram, pounds, tons) in order to ensure that all data can properly be presented in kilograms as the default unit of mass
Take the Net Weight Original if filled – when net weight is applicable we prioritize the net weight as presented
Search for net weights mentioned in the product description – for all known net weight values historically present in the data, a search is carried out together with the word “Net weight” or synonyms like “Net WT” Quantity to Net Weight – for all values in the “quantity” column and having a “quantity unit” of kilogram, the net weight is calculated
Shipment Coverage
Country | Type of data | Coverage 2023 | Volume available? | % Shipment records with value |
Angola | Customs | 197% | Yes | 80% |
Argentina | Customs | 116% | Yes | 74% |
Armenia | Mirror | 13% | Yes | 84% |
Australia | Mirror | 16% | Yes | 23% |
Azerbaijan | Mirror | 59% | Yes | 94% |
Bahrain | Mirror | 38% | Yes | 28% |
Bangladesh | Mirror | 258% | Yes | 90% |
Belize | Mirror | 26% | Yes | 29% |
Bhutan | Mirror | 266% | Yes | 98% |
Bolivia | Mirror | 99% | Yes | 94% |
Botswana | Mirror | 355% | Yes | 50% |
Brazil | Customs | 68% | Yes | 84% |
Brunei | Mirror | 18% | Yes | 30% |
Burkina Faso | Mirror | 42% | Yes | 100% |
Cambodia | Mirror | 19% | Yes | 57% |
Cameroon | Mirror | 181% | Yes | 78% |
Chile | Customs | 96% | Yes | 97% |
China | Mirror | 52% | Yes | 2% |
Colombia | Customs | 103% | Yes | 75% |
Congo | Mirror | 16% | Yes | 19% |
Costa Rica | Customs | 80% | Yes | 0% |
Côte d'Ivoire | Mirror | 183% | Yes | 95% |
Djibouti | Mirror | 43% | Yes | 0% |
Ecuador | Customs | 109% | Yes | 83% |
Egypt | Mirror | 8% | Yes | 0% |
Fiji | Mirror | 68% | Yes | 36% |
Georgia | Mirror | 27% | Yes | 86% |
Ghana | Customs | 175% | Yes | 57% |
Hong Kong | Mirror | 12% | Yes | 15% |
Indonesia | Customs | 59% | Yes | 9% |
Japan | Mirror | 33% | Yes | 20% |
Jordan | Mirror | 3% | Yes | 3% |
Kazakhstan | Customs | 218% | Yes | 96% |
Kuwait | Mirror | 26% | Yes | 14% |
Lebanon | Mirror | 19% | Yes | 6% |
Malaysia | Mirror | 29% | Yes | 21% |
Mexico | Customs | 65% | Yes | 87% |
Moldova | Mirror | 660% | Yes | 91% |
Mongolia | Mirror | 63% | Yes | 96% |
Mozambique | Mirror | 205% | Yes | 98% |
Namibia | Mirror | 90% | Yes | 47% |
Nepal | Mirror | 115% | Yes | 99% |
New Zealand | Mirror | 14% | Yes | 9% |
Nigeria | Mirror | 24% | Yes | 93% |
Oman | Mirror | 21% | Yes | 42% |
Pakistan | Customs | 180% | Yes | 80% |
Panama | Customs | 119% | Yes | 85% |
Paraguay | Customs | 91% | Yes | 98% |
Peru | Customs | 104% | Yes | 90% |
Philippines | Customs | 102% | Yes | 80% |
Qatar | Mirror | 29% | Yes | 28% |
Russia | Customs | 101% | Yes | 94% |
Saudi Arabia | Mirror | 32% | Yes | 11% |
Senegal | Mirror | 8% | Yes | 0% |
Sierra Leone | Mirror | 21% | Yes | 0% |
Singapore | Mirror | 17% | Yes | 24% |
Somalia | Mirror | 34% | Yes | 25% |
South Africa | Mirror | 19% | Yes | 44% |
South Korea | Mirror | 41% | Yes | 27% |
Sri Lanka | Customs | 197% | Yes | 33% |
Suriname | Mirror | 6% | Yes | 0% |
Taiwan | Mirror | 40% | Yes | 19% |
Tanzania | Mirror | 98% | Yes | 87% |
Thailand | Mirror | 46% | Yes | 20% |
Ukraine | Customs | 87% | Yes | 98% |
United Arab Emirates | Mirror | 16% | Yes | 31% |
United States | Customs | 22% | Yes | 1% |
Uruguay | Customs | 120% | Yes | 99% |
Uzbekistan | Customs | 249% | Yes | 94% |
Venezuela | Customs | 53% | Yes | 95% |
Vietnam | Customs | 158% | Yes | 76% |
Zimbabwe | Mirror | 175% | Yes | 0% |