4. Data Analytics with xGT

The following sections are available in this chapter:

• 4.1. Graph Thinking
  • 4.1.1. Introduction
  • 4.1.2. Graph Model
  • 4.1.3. Graph Image
  • 4.1.4. Setting up the Graph Model in xGT
    • 4.1.4.1. Understanding the Vertices
    • 4.1.4.2. Understanding the Edges
    • 4.1.4.3. Data Loading
  • 4.1.5. Looking for Interesting Patterns
    • 4.1.5.1. Describing the First Relationship
    • 4.1.5.2. Describing the Second Relationship
    • 4.1.5.3. Understanding the Query Result
    • 4.1.5.4. Exploring the Query Result
  • 4.1.6. Concluding Remarks
  • 4.1.7. Graph Thinking Jupyter Notebook
• 4.2. Graph Data Model: Frames and Namespaces
  • 4.2.1. Types of Frames in xGT
  • 4.2.2. Creating Frames
  • 4.2.3. Dropping Frames
  • 4.2.4. Namespaces
  • 4.2.5. Access Control
    • 4.2.5.1. Frame Access Control
    • 4.2.5.2. Row Access Control
• 4.3. Data Types and Operators in xGT
  • 4.3.1. Data Types
    • 4.3.1.1. BOOLEAN
    • 4.3.1.2. INTEGER
    • 4.3.1.3. FLOAT
    • 4.3.1.4. DATE
    • 4.3.1.5. TIME
    • 4.3.1.6. DATETIME
    • 4.3.1.7. IPADDRESS
    • 4.3.1.8. TEXT
  • 4.3.2. Supported Operators
• 4.4. Data Movement
  • 4.4.1. Getting Data into xGT
    • 4.4.1.1. Reading from the Client Filesystem
    • 4.4.1.2. Reading from the Server Filesystem
    • 4.4.1.3. Reading from a URL
    • 4.4.1.4. Reading from an AWS S3 Bucket
    • 4.4.1.5. Inserting from Python
    • 4.4.1.6. Setting Row Labels
    • 4.4.1.7. Reading Into Edge Frames
    • 4.4.1.8. Handling Ingest Errors
    • 4.4.1.9. Digging Deeper into Ingest Errors
  • 4.4.2. Getting Data out of xGT
    • 4.4.2.1. Saving to the Client Filesystem
    • 4.4.2.2. Saving to the Server Filesystem
    • 4.4.2.3. Saving to Python
    • 4.4.2.4. Saving Row Labels
  • 4.4.3. Performance Considerations
  • 4.4.4. S3 Credentials
• 4.5. Job Management and History
  • 4.5.1. Job Object
  • 4.5.2. Jobs with Immediate Query Results
  • 4.5.3. Querying the Job History
• 4.6. Introduction to the Trovares Query Language (TQL)
  • 4.6.1. Structure
    • 4.6.1.1. Putting It All Together
    • 4.6.1.2. Non-linear Patterns
    • 4.6.1.3. Variable-length Edge Traversal
  • 4.6.2. Constraints on Properties
  • 4.6.3. Functions
    • 4.6.3.1. Aggregation Functions
    • 4.6.3.2. Conversion Functions
    • 4.6.3.3. Mathematical Functions
    • 4.6.3.4. String Functions
    • 4.6.3.5. Degree Functions
    • 4.6.3.6. Function to Enforce Distinct Vertices
  • 4.6.4. Constant Expressions
  • 4.6.5. CASE Expressions
    • 4.6.5.1. Simple CASE Expressions
    • 4.6.5.2. Generic CASE Expressions
    • 4.6.5.3. Examples
  • 4.6.6. Cypher Parameters
  • 4.6.7. Modifications, Additions and Deletions
    • 4.6.7.1. Property Modifications
    • 4.6.7.2. Topology Additions
    • 4.6.7.3. Topology Deletions
    • 4.6.7.4. Visibility of Changes to the Graph
  • 4.6.8. What Is an Answer to a TQL Query?
  • 4.6.9. Describing the Answer to a TQL Query
  • 4.6.10. Modifying How the Answer Set Is Reported
  • 4.6.11. Specifying the Results Table
  • 4.6.12. Querying over a Table Frame
  • 4.6.13. Multiple Query Sections
    • 4.6.13.1. Carrying Information Using WITH
    • 4.6.13.2. Aliasing in the WITH Clause
    • 4.6.13.3. Additional Filtering of WITH Partial Results
    • 4.6.13.4. Visibility of Changes
    • 4.6.13.5. Use Cases of Multiple Query Sections
    • 4.6.13.6. Additional Rules
    • 4.6.13.7. Performance Considerations
  • 4.6.14. Row Access Control in Queries
• 4.7. TQL for Cypher Users
  • 4.7.1. xGT TQL Queries
    • 4.7.1.1. Fundamental Concepts in TQL’s Subset of Cypher
    • 4.7.1.2. Property and Topology Modifications as Part of Queries
    • 4.7.1.3. Aggregation Functions and Solution Modifiers
  • 4.7.2. Examples of TQL Queries
    • 4.7.2.1. Example 1
    • 4.7.2.2. Example 2
    • 4.7.2.3. Example 3
    • 4.7.2.4. Example 4
    • 4.7.2.5. Example 5
    • 4.7.2.6. Example 6
    • 4.7.2.7. Example 7
    • 4.7.2.8. Example 8
    • 4.7.2.9. Example 9
    • 4.7.2.10. Example 10
  • 4.7.3. Type Inference in TQL Queries
  • 4.7.4. Limitations on TQL’s Cypher Support
• 4.8. Access Control
  • 4.8.1. Security Labels
  • 4.8.2. Frame Access Control
    • 4.8.2.1. Creating Frames with Frame Security
    • 4.8.2.2. Namespace Labels
    • 4.8.2.3. Access Types for xGT Operations
  • 4.8.3. Row Access Control
    • 4.8.3.1. Attaching Row Labels to Data
    • 4.8.3.2. Security Labels Created by TQL Queries
    • 4.8.3.3. Performance
    • 4.8.3.4. Result Frames with Row Labels
    • 4.8.3.5. Viewing Security Labels
  • 4.8.4. Additional Rules and Corner Cases
    • 4.8.4.1. Edge Access
    • 4.8.4.2. Degree Computation
    • 4.8.4.3. Row Label Universe Requirements
• 4.9. Transactions in xGT
  • 4.9.1. Transaction Basics
  • 4.9.2. Using Transactions in Python
  • 4.9.3. Data Loading and Saving
  • 4.9.4. Data Modification in TQL
  • 4.9.5. Background Statistics Collection
• 4.10. Query Optimization
  • 4.10.1. Checking the Status of Statistics Collection