Skip to content

Releases: bgpkit/monocle

v1.0.2

19 Dec 02:42
71ebeb9

Choose a tag to compare

New Features

  • Added new monocle pfx2as command for prefix-to-ASN mapping lookups

    • Search by prefix: Query prefixes to find their origin ASNs
      • Example: monocle pfx2as 1.1.1.0/24
    • Search by ASN: Query an ASN to find all its announced prefixes
      • Example: monocle pfx2as 13335 or monocle pfx2as AS13335
    • RPKI validation: Shows RPKI validation status (valid/invalid/not_found) for each prefix-ASN pair
    • --show-name: Display AS organization name for each origin ASN
    • --include-sub: Include sub-prefixes (more specific) in results
      • Example: monocle pfx2as 8.0.0.0/8 --include-sub --limit 20
    • --include-super: Include super-prefixes (less specific) in results
      • Example: monocle pfx2as 1.1.1.0/24 --include-super
    • --limit: Limit the number of results
    • Supports all standard output formats (--format table/json/psv/etc.)
  • Enhanced monocle as2rel command with advanced filtering and multi-ASN support

    • --min-visibility <PERCENT>: Filter results by minimum visibility percentage (0-100)
      • Available for all as2rel queries
      • Filters out relationships seen by fewer than the specified percentage of peers
    • --single-homed: Find ASNs that are single-homed to the queried ASN
      • Shows only ASNs where the queried ASN is their ONLY upstream provider
      • Useful for identifying customers with no redundancy
      • Example: monocle as2rel 2914 --single-homed
    • --is-upstream: Filter to show only downstream customers of the queried ASN
      • Shows relationships where the queried ASN is the upstream (provider)
    • --is-downstream: Filter to show only upstream providers of the queried ASN
      • Shows relationships where the queried ASN is a downstream (customer)
    • --is-peer: Filter to show only peer relationships (settlement-free interconnection)
    • Multi-ASN support: Query relationships among multiple ASNs at once
      • When more than two ASNs are provided, shows all pair combinations
      • Results sorted by asn1, with asn1 < asn2 for each pair
      • Example: monocle as2rel 174 2914 3356 shows all three pair relationships
  • Added global --no-refresh flag to disable automatic data refresh

    • Use monocle --no-refresh <command> to skip all automatic data loading/refresh
    • Useful when you want to use existing cached data only
    • Shows warnings when data is missing or stale instead of auto-refreshing
  • Added Docker support with multi-stage build

    • Dockerfile with two-stage build process for minimal image size (~176MB final image)
    • Uses Rust 1.92 and Debian trixie-slim as runtime base
    • docker-compose.yml for easy container orchestration
    • .dockerignore to optimize build context
    • Runs as non-root user for security
    • Persistent data volume at /data
    • Default server mode with port 8080 exposed

Bug Fixes

  • Fixed "database is locked" error in monocle config db-refresh command (Issue #90)
    • The do_refresh function was opening redundant database connections for ASInfo and AS2Rel data sources
    • Now correctly uses the already-passed database connection parameter

Improvements

  • Added visual ... row indicator in tables when results are truncated

    • Search results table now shows a ... row when more matches exist
    • RPKI ROA tables show truncation indicator
    • Announced prefixes table shows truncation indicator
    • Connectivity section (upstreams/peers/downstreams) tables show truncation indicator
    • Makes it much more visible that additional results are available
  • Added [monocle] prefix to all auto-refresh log messages

    • Makes it easier to distinguish monocle's internal logging from main output
    • Especially useful when refresh operations run automatically during commands
  • RPKI ASPA command now ensures ASInfo data is available for AS name enrichment

    • Automatically loads ASInfo data before showing ASPA output
    • AS names and countries are displayed in ASPA results
  • Added comprehensive tests for database initialization with mock data

    • Tests for all repositories being accessible after initialization
    • Tests for schema version verification
    • Tests for RPKI and Pfx2as mock data storage/retrieval

v1.0.1

18 Dec 08:10
42730e5

Choose a tag to compare

Bug Fixes

  • Fixed cross-compilation issue on Linux platforms caused by OpenSSL dependency
    • Updated bgpkit-commons to v0.10.1 which uses rustls instead of native-tls
    • All TLS operations now use rustls, eliminating the need for OpenSSL development packages

v1.0.0

18 Dec 07:48
ae24166

Choose a tag to compare

This is a major release with significant architectural changes, new commands, and breaking changes.

Breaking Changes

  • Command Removals & Renames:
    • Removed broker command (use search --broker-files instead).
    • Removed radar command (access Cloudflare Radar directly via their API).
    • Removed rpki list and rpki summary commands (use rpki roas instead).
    • Renamed rpki check to rpki validate.
    • Renamed whois to inspect (unified AS/prefix lookup command).
  • Library API:
    • All public functions are now accessed through lens structs (e.g., InspectLens, RpkiLens).
  • Output:
    • Default output format changed from markdown to table (pretty borders).

New Features

New Commands

  • monocle inspect: Unified AS/prefix information lookup.
    • Replaces whois and pfx2as.
    • Auto-detects query type (ASN, prefix, IP address, or name).
    • Combines data from ASInfo, AS2Rel, RPKI, and Pfx2as.
  • monocle server: WebSocket API Server.
    • JSON-RPC style protocol with streaming support.
    • Endpoints for all major monocle operations.
  • monocle config: Consolidated configuration and database management.
    • Manage data sources, refresh data, and backup database.
  • monocle as2rel: AS Relationship lookup.
    • Query relationships, peers, and upstreams.

ASPA Support

  • Enrichment:
    • Enriched customer/provider names and countries via SQL JOINs.
    • Unified provider structure in JSON output (providers array with {asn, name} objects).

Core Enhancements

  • Unified Output Format: Global --format option for all commands (table, markdown, json, json-pretty, json-line, psv).
  • SQLite Integration:
    • ASInfo: Unified AS information stored in SQLite (replaces as2org).
    • Pfx2as: Prefix-to-ASN mappings cached in SQLite for fast range lookups.
    • RPKI: ROAs and ASPAs cached in SQLite.
  • Progress Tracking: Library support for callback-based progress reporting in ParseLens and SearchLens.
  • Feature Flags: Reorganized into tiers (database, lens-core, lens-bgpkit, lens-full, display, cli).

Improvements

  • monocle inspect:
    • Progress messages during data loading.
    • Improved output formatting with section headers.
    • Performance optimization (lazy loading of data sources).
  • General:
    • Name truncation: Long names in tables are truncated to 20 chars (disable with --show-full-name).
    • Database performance: Optimized batch insert operations.
    • Broken pipe handling: Graceful exit when piping output (e.g., to head).

Bug Fixes

  • Handle SIGPIPE gracefully to prevent panics when piping output.

Documentation

  • Added WebSocket server documentation.
  • Updated all documentation references and examples.

Code Improvements

  • Lens-based architecture: Centralized logic in src/lens/.
  • Refactoring: Improved CLI command organization.
  • Examples: Added comprehensive examples for all feature tiers.

Dependencies

  • Added bgpkit-commons (asinfo, rpki, countries).
  • Added server dependencies (axum, tokio, etc.).
  • Added libc (used for SIGPIPE handling on Unix systems).
  • Removed rpki crate.

v0.9.1

06 Nov 03:03
92ac48e

Choose a tag to compare

Maintenance

  • update dependencies
    • oneio -> v0.20.0
    • bgpkit-parser -> v0.12.0
    • bgpkit-broker -> v0.9.1

Bug fixes

  • Fix an issue where monocle fails to locate the latest CAIDA as2org dataset file

v0.9.0

04 Sep 23:22
3ebaef0

Choose a tag to compare

New features

  • Added retry mechanism for failed search operations with exponential backoff
  • Implemented real-time success/failure progress tracking during search
  • Added paginated search processing for large time ranges to handle memory efficiently

Performance improvements

  • Database bootstrap performance improvements
    • Added proper transaction management for bulk inserts
    • Replaced string-based SQL with prepared statements
    • Added database indexes for common query patterns
    • Enabled SQLite performance optimizations (WAL mode, cache tuning)
    • Impact: BGP data insertion ~10x faster, as2org bootstrap ~100x faster (3+ minutes → 1-2 seconds)

Bug fixes

  • Fixed network error handling in multi-file processing to prevent thread panics

Code improvements

  • Replaced unwrap/expect calls with proper error handling
  • Added clippy lints to deny unsafe unwrap_used and expect_used patterns
  • Updated CI workflow to include formatting and clippy checks
  • Enhanced database operations with proper Result types
  • Improved RPKI validator error handling

v0.8.0

04 Mar 19:11
c83b0af

Choose a tag to compare

New subcommand

  • added monocle pfx2as subcommand to allow bulk prefix-to-asn mapping using BGPKIT dataset
    • it takes a list of prefixes or prefix files (one prefix per line)

Example:

monocle pfx2as 1.1.1.0/24 8.8.8.0/24 --json
[
  {
    "origin": 13335,
    "prefix": "1.1.1.0/24"
  },
  {
    "origin": 15169,
    "prefix": "8.8.8.0/24"
  }
]

Maintenance

  • update dependencies
    • note that we upgraded to bgpkit-parser v0.11 and community values are now without prefixes such as lg: ecv6

v0.7.2

08 Jan 20:26
cbf5ed1

Choose a tag to compare

Improvements

  • support searching data from RIB dumps by specifying --dump-type argument
    • --dump-type updates: search updates files only
    • --dump-type rib: search RIB files only
    • --dump-type rib-updates: search RIB dump and updates
  • improved internal handling of filters and time string parsing
  • improved documentation

v0.7.1

27 Dec 19:51
c4f3a30

Choose a tag to compare

Maintenance

  • add back Cargo.lock file for reproducible builds

v0.7.0

27 Dec 17:20
249dec4

Choose a tag to compare

New Features

monocle ip command

Add a new monocle ip command to retrieve information for the current IP of the machine or any specified IP address,
including location, network (ASN, network name) and the covering IP prefix of the given IP address.

The command triggers an API call to BGPKIT API,
and it retrieves the information based on the incoming requester IP address with additional BGP information for the
enclosing IP prefixes.

➜  ~ monocle ip
+----------+--------------------------+
| ip       | 104.48.0.0               |
+----------+--------------------------+
| location | US                       |
+----------+---------+----------------+
| network  | asn     | 7018           |
|          +---------+----------------+
|          | country | US             |
|          +---------+----------------+
|          | name    | AT&T US - 7018 |
|          +---------+----------------+
|          | prefix  | 104.48.0.0/12  |
|          +---------+----------------+
|          | rpki    | valid          |
+----------+---------+----------------+

➜  ~ monocle ip 1.1.1.1
+----------+----------------------+
| ip       | 1.1.1.1              |
+----------+----------------------+
| location | US                   |
+----------+---------+------------+
| network  | asn     | 13335      |
|          +---------+------------+
|          | country | US         |
|          +---------+------------+
|          | name    | Cloudflare |
|          +---------+------------+
|          | prefix  | 1.1.1.0/24 |
|          +---------+------------+
|          | rpki    | valid      |
+----------+---------+------------+

➜  ~ monocle ip 1.1.1.1 --json
{
  "ip": "1.1.1.1",
  "location": "US",
  "network": {
    "asn": 13335,
    "country": "US",
    "name": "Cloudflare",
    "prefix": "1.1.1.0/24",
    "rpki": "valid"
  }
}

MRT export for monocle parse command

The monocle parse command now supports
exporting filtered BGP messages into MRT files by supplying an MRT file path with --mrt-path argument.

Improved time string parsing

The parsing of time strings in monocle time and monocle search now utilizes dateparser for natural
date strings like May 6 at 9:24 PM or 2019-11-29 08:08-08.
It now also allows specifying a duration like 1h or "2 hours" to replace --start-ts or --end-ts.

Other improvements

  • Updated documentation for various commands
  • Cleaned up dependencies in the Cargo.toml file

v0.6.2

28 Oct 15:49
1ea2925

Choose a tag to compare

Dependency updates

  • bgpkit-broker to v0.7.0 -> v0.7.5
  • bgpkit-parser to v0.10.9 -> v0.10.11

bgpkit-parser version v0.10.11 fixes the improper handling of AS23456 (AS_TRANS). If you previously see
AS23456 incorrectly showing on the path, it should no-longer showing up after this patchshould no-longer show up after
this patch.

Fixes

  • fixed a bug where psv format output does not actually print out content.