Scalable graph analytics using xGT

The Trovares xGT application is a property graph engine designed to support extremely large in-memory graphs. Our analytics tool provides large graph search capabilities for data scientists and business analysts. With rapid ingest rates and the ability to execute complex queries driven by Python scripts, xGT provides unprecedented performance and scalability, especially when processing very large data.

---

• 1. What Is xGT?
  • 1.1. Architecture
  • 1.2. Client
  • 1.3. Server
  • 1.4. Quick Start Guide
• 2. Managing an xGT Site
  • 2.1. Installing xGT
    • 2.1.1. Supported Environments
    • 2.1.2. Licensing
  • 2.2. Configuring the xGT Server
    • 2.2.1. Configuring Groups and Labels
    • 2.2.2. Configuring Administrator Privileges
    • 2.2.3. Configuring the locale
    • 2.2.4. Using an SSL Secure Channel
  • 2.3. Enterprise Data Movement
    • 2.3.1. Common Usage Patterns
    • 2.3.2. Configuring the Data Sandbox
    • 2.3.3. Granting Data Sandbox Access to Users
  • 2.4. Memory and Compute Resources
    • 2.4.1. Monitoring Usage
    • 2.4.2. Setup and Configuration On-premises
    • 2.4.3. xgtd Using the Whole Server Platform
    • 2.4.4. xgtd Sharing the Server Platform
    • 2.4.5. Multiple xgtd Instances Running on a Server Platform
  • 2.5. User Authentication and Access Control
    • 2.5.1. User Authentication
    • 2.5.2. Access Control
  • 2.6. System Frames in xGT
  • 2.7. Logging and Auditing
    • 2.7.1. General Logging
    • 2.7.2. Security Audit Logging
  • 2.8. xGT License Management System
    • 2.8.1. xGT Licensing
    • 2.8.2. License Management System Components
    • 2.8.3. Preparing to Install
    • 2.8.4. Installing
    • 2.8.5. Operations and Maintenance
    • 2.8.6. Logging
    • 2.8.7. License File Format
    • 2.8.8. LM-X Error Messages
• 3. Using the xGT System
  • 3.1. Installing the xGT Client
    • 3.1.1. Installing from PyPi
    • 3.1.2. Installing from a Distribution Tarball
    • 3.1.3. Recommended Packages
    • 3.1.4. Verifying Installation
  • 3.2. Connecting to a Server
    • 3.2.1. Use SSH Tunneling
    • 3.2.2. Connect Via SSL-encrypted Network Connection
    • 3.2.3. Connecting to an Open Port
    • 3.2.4. User Authentication
  • 3.3. Using the Python Library
  • 3.4. Driving from a Jupyter Notebook
    • 3.4.1. Useful Notebook Cells
  • 3.5. Capabilities of the xGT Client
    • 3.5.1. Mixed-language Programming
• 4. Data Analytics with xGT
  • 4.1. Graph Thinking
    • 4.1.1. Introduction
    • 4.1.2. Graph Model
    • 4.1.3. Graph Image
    • 4.1.4. Setting up the Graph Model in xGT
    • 4.1.5. Looking for Interesting Patterns
    • 4.1.6. Concluding Remarks
    • 4.1.7. Graph Thinking Jupyter Notebook
  • 4.2. Graph Data Model: Frames and Namespaces
    • 4.2.1. Types of Frames in xGT
    • 4.2.2. Creating Frames
    • 4.2.3. Dropping Frames
    • 4.2.4. Namespaces
    • 4.2.5. Access Control
  • 4.3. Data Types and Operators in xGT
    • 4.3.1. Data Types
    • 4.3.2. Supported Operators
  • 4.4. Data Movement
    • 4.4.1. Getting Data into xGT
    • 4.4.2. Getting Data out of xGT
    • 4.4.3. Performance Considerations
    • 4.4.4. S3 Credentials
  • 4.5. Job Management and History
    • 4.5.1. Job Object
    • 4.5.2. Jobs with Immediate Query Results
    • 4.5.3. Querying the Job History
  • 4.6. Introduction to the Trovares Query Language (TQL)
    • 4.6.1. Structure
    • 4.6.2. Constraints on Properties
    • 4.6.3. Functions
    • 4.6.4. Constant Expressions
    • 4.6.5. CASE Expressions
    • 4.6.6. Cypher Parameters
    • 4.6.7. Modifications, Additions and Deletions
    • 4.6.8. What Is an Answer to a TQL Query?
    • 4.6.9. Describing the Answer to a TQL Query
    • 4.6.10. Modifying How the Answer Set Is Reported
    • 4.6.11. Specifying the Results Table
    • 4.6.12. Querying over a Table Frame
    • 4.6.13. Multiple Query Sections
    • 4.6.14. Row Access Control in Queries
  • 4.7. TQL for Cypher Users
    • 4.7.1. xGT TQL Queries
    • 4.7.2. Examples of TQL Queries
    • 4.7.3. Type Inference in TQL Queries
    • 4.7.4. Limitations on TQL’s Cypher Support
  • 4.8. Access Control
    • 4.8.1. Security Labels
    • 4.8.2. Frame Access Control
    • 4.8.3. Row Access Control
    • 4.8.4. Additional Rules and Corner Cases
  • 4.9. Transactions in xGT
    • 4.9.1. Transaction Basics
    • 4.9.2. Using Transactions in Python
    • 4.9.3. Data Loading and Saving
    • 4.9.4. Data Modification in TQL
    • 4.9.5. Background Statistics Collection
  • 4.10. Query Optimization
    • 4.10.1. Checking the Status of Statistics Collection
• 5. Useful Recipes
  • 5.1. Wrappers to the Python API
    • 5.1.1. Frame Drop
    • 5.1.2. Run Query
  • 5.2. Analytics Idioms
    • 5.2.1. Compute Column Statistics
    • 5.2.2. Compute a Column Histogram
    • 5.2.3. Generic Frame-type Idiom
• 6. Code Samples
• 7. Python API
  • 7.1. Main Features
    • 7.1.1. Data Loading
    • 7.1.2. Query Processing
    • 7.1.3. Example Script
  • 7.2. General
    • 7.2.1. xgt.Connection
    • 7.2.2. xgt.Job
  • 7.3. Data Access and Manipulation
    • 7.3.1. xgt.VertexFrame
    • 7.3.2. xgt.EdgeFrame
    • 7.3.3. xgt.TableFrame
  • 7.4. Exceptions
    • 7.4.1. xgt.XgtError
    • 7.4.2. xgt.XgtSecurityError
    • 7.4.3. xgt.XgtArithmeticError
    • 7.4.4. xgt.XgtConnectionError
    • 7.4.5. xgt.XgtFrameDependencyError
    • 7.4.6. xgt.XgtInternalError
    • 7.4.7. xgt.XgtIOError
    • 7.4.8. xgt.XgtNameError
    • 7.4.9. xgt.XgtNotImplemented
    • 7.4.10. xgt.XgtServerMemoryError
    • 7.4.11. xgt.XgtSyntaxError
    • 7.4.12. xgt.XgtTransactionError
    • 7.4.13. xgt.XgtTypeError
    • 7.4.14. xgt.XgtValueError
  • 7.5. Admin
• 8. xGT Release Notes
  • 8.1. 1.6.0 (4-2-2021)
    • 8.1.1. New Features
    • 8.1.2. Changed
    • 8.1.3. Fixed
  • 8.2. 1.5.1 (2-19-2021)
    • 8.2.1. Changed
    • 8.2.2. Fixed
  • 8.3. 1.5.0 (2-8-2021)
    • 8.3.1. New Features
    • 8.3.2. Changed
    • 8.3.3. Fixed
    • 8.3.4. Unresolved
  • 8.4. 1.4.2 (09-28-2020)
    • 8.4.1. Fixed
  • 8.5. 1.4.1 (09-18-2020)
    • 8.5.1. New Features
    • 8.5.2. Changed
    • 8.5.3. Fixed
  • 8.6. 1.4.0 (08-24-2020)
    • 8.6.1. New Features
    • 8.6.2. Changed
    • 8.6.3. Fixed
    • 8.6.4. Unresolved
  • 8.7. 1.3.0 (11-05-2019)
    • 8.7.1. New Features
    • 8.7.2. Changed
    • 8.7.3. Fixed
  • 8.8. 1.2.0 (06-04-2019)
    • 8.8.1. New Features
    • 8.8.2. Changed
    • 8.8.3. Fixed
  • 8.9. 1.1.0 (02-21-2019)
    • 8.9.1. New Features
    • 8.9.2. Changed
    • 8.9.3. Fixed
  • 8.10. 1.0.0 (12-01-2018)
    • 8.10.1. New Features
    • 8.10.2. Changed
    • 8.10.3. Fixed
  • 8.11. 0.18.0 (10-24-2018)
    • 8.11.1. Changed
    • 8.11.2. Fixed
  • 8.12. 0.17.0 (10-01-2018)
    • 8.12.1. Changed
    • 8.12.2. Fixed
  • 8.13. 0.16.0 (09-01-2018)
    • 8.13.1. Changed
    • 8.13.2. Fixed
• 9. Appendices
  • 9.1. Exhaustive List of LM-X Error Messages
• 10. Glossary