insyra

package module
v0.2.15 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Mar 5, 2026 License: MIT Imports: 39 Imported by: 2

README

Insyra - Crafting Your Art of Data

Test GolangCI-Lint Govulncheck Go version Go Report Card GoDoc MIT license

A next-generation data analysis library for Golang. Supports parallel processing, data visualization, and seamless integration with Python.

Official Website: https://insyra.hazelnut-paradise.com

Documentation: https://hazelnutparadise.github.io/insyra/

Go.dev Package: https://pkg.go.dev/github.com/HazelnutParadise/insyra

[!NOTE] This project is evolving rapidly—please star and watch the repository to stay up to date with the latest changes!

logo

繁體中文版 README

Fast, Lovely, Easy To Use

The Insyra library is a dynamic and versatile tool designed for managing and analyzing data in Go. It offers a rich set of features for data manipulation, statistical calculations, data visualization, and more, making it an essential toolkit for developers handling complex data structures.

[!TIP] isr package provides Sytax Sugar!
Any new project is recommended to use isr package instead of calling insyra main package directly.
For more details, please refer to the Documentation.

[!NOTE] If some functions or methods in the documentation are not working, it may be because the feature is not yet included in the latest release. Please refer to the documentation in the source code of the corresponding version in Releases.

[!IMPORTANT] For any functions or methods not explicitly listed in Insyra documents, it indicates that the feature is still under active development. These experimental features might provide unstable results.
Please refer to our latest updates in Docs folder for more details.

AI / Agent Skills

This repository includes agent skills:

  • skills/insyra: helps AI agents use Insyra in Go code (DataList/DataTable workflows, CCL formulas, and common file I/O helpers).
  • skills/use-insyra-cli: teaches agents how to use Insyra CLI/REPL and .isr scripts, including environment workflows and full command reference.

Quick picker:

  • Use skills/insyra when the task is to write or modify Go code using Insyra APIs.
  • Use skills/use-insyra-cli when the task should be done via insyra commands, REPL, or .isr scripts.
  • Use both when you need a hybrid flow (CLI prototyping first, then productionize in Go code).

It is platform-agnostic and can be used with OpenClaw, Claude Code, opencode, or any skill-capable agent runtime.

Example prompts:

  • "Use insyra to read data.csv, add a derived column with CCL, and export to output.csv."
  • "Use insyra DataList to compute mean/std and show a quick preview."

Idensyra

We provide a mini Go IDE, Idensyra, which aims to make data analysis even more easier (though Insyra has already made it very easy).

Idensyra comes with Insyra pre-installed, and allows you to run Go code without installing Go environment!

Know more about Idensyra

Getting Started

Start Here: Guided Tutorials

If you want a practical, end-to-end way to learn Insyra, start with the guided tutorials.

  • Tutorial hub: Docs/tutorials/README.md
  • Featured tutorial: Sales Analysis End-to-End
  • New tutorial tracks: data quality, parquet streaming, A/B statistics, RFM+CAI segmentation, yfinance trend, interactive plot dashboards, static gplot reports, LP capacity planning, Python + parallel batch.

The featured tutorial walks through a full workflow: CSV setup -> DataTable loading -> CCL enrichment -> sorting -> KPI aggregation -> CSV export.

For those new to Golang

[!TIP] Jump to Installation or Quick Example if you are familiar with Go.

  1. Download and install Golang from here.

  2. Set up your editor, we recommend using VSCode. Or even lighter weight, Idensyra.

  3. Open or create a folder for your project, and open it in the editor.

  4. Create a new project by running the following command:

    go mod init your_project_name

  5. Install Insyra:

    go get github.com/HazelnutParadise/insyra/allpkgs

  6. Create a new file, e.g., main.go, and write the following code:

    package main

import (
    "fmt"
    "github.com/HazelnutParadise/insyra"
)

func main() {
    // Your code here
}

  7. Run your project:

    go run main.go
Installation

  • To start using Insyra, install it with the following command:

    go get github.com/HazelnutParadise/insyra/allpkgs

  • Update Insyra to the latest version:

    go get -u github.com/HazelnutParadise/insyra/allpkgs

    or

    go get -u github.com/HazelnutParadise/insyra/allpkgs@latest
Quick Example
package main

import (
    "fmt"
    "github.com/HazelnutParadise/insyra"
)

func main() {
    dl := insyra.NewDataList(1, 2, 3, 4, 5)
    dl.Append(6)
    fmt.Println("DataList:", dl.Data())
    fmt.Println("Mean:", dl.Mean())
}
Syntactic Sugar

It is strongly recommended to use syntactic sugar since it is much more power and easier to use. For example, the above code can be written as:

package main

import (
 "fmt"

 "github.com/HazelnutParadise/insyra/isr"
)

func main() {
 dl := isr.DL.Of(1, 2, 3, 4, 5)
 dl.Append(6)
 dl.Show()
 fmt.Println("Mean:", dl.Mean())
}

To use the syntactic sugar, import github.com/HazelnutParadise/insyra/isr.

Console Preview with insyra.Show

Need a quick labelled look at any showable structure (like DataTable or DataList)? Use the package-level Show helper, which delegates to ShowRange under the hood and supports the same range arguments:

func main() {
    dt := insyra.NewDataTable(
        insyra.NewDataList("Alice", "Bob", "Charlie").SetName("Name"),
        insyra.NewDataList(28, 34, 29).SetName("Age"),
    ).SetName("Team Members")

    insyra.Show("Preview", dt, 2) // First two rows
}
Configuration

See Docs/Configuration.md.

CLI Quick Examples

Install the CLI (recommended):

go install github.com/HazelnutParadise/insyra/cmd/insyra@latest

The binary is installed to $GOBIN (or $GOPATH/bin if $GOBIN is not set).

[!TIP] On Windows, if insyra is not found, add %USERPROFILE%\\go\\bin (or your %GOBIN%) to PATH, then reopen your terminal.

Start REPL:

insyra

Run commands directly (non-REPL):

insyra newdl 1 2 3 4 5 as x
insyra mean x

Advanced command examples:

# Regression
insyra regression linear y x1 x2 as reg

# Hypothesis test
insyra ttest two group_a group_b equal

# Plot
insyra plot line sales save sales.html

# Fetch (Yahoo Finance)
insyra fetch yahoo AAPL quote as q

# Partial Parquet load (selected columns + row groups)
insyra load parquet data.parquet cols id,amount,status rowgroups 0,1 as t

[!TIP] Use --env <name> to isolate analysis contexts, e.g. insyra --env exp1.

For full CLI + DSL documentation, see Docs/cli-dsl.md.

Thread Safety and Defensive Copies

  • Defensive copies: Insyra returns defensive copies for all public data accessors. Any method that exposes internal slices, maps, or other mutable structures returns a copy so callers cannot mutate internal state unintentionally.
  • Atomic operations: For safe concurrent multi-step operations, use the helper AtomicDo. AtomicDo serializes all operations for an instance via a dedicated actor goroutine and a command channel (see atomic.go), avoiding mutexes.

DataList

The DataList is the core structure in Insyra, enabling the storage, management, and analysis of dynamic data collections. It offers various methods for data manipulation and statistical analysis.

For a complete list of methods and features, please refer to the DataList Documentation.

DataTable

The DataTable structure provides a tabular data representation, allowing for the storage and manipulation of data in a structured format. It offers methods for data filtering, sorting, and aggregation, making it a powerful tool for data analysis.

You can also convert between DataTables and CSV files with simply one line of code, enabling seamless integration with external data sources.

Error Handling (instance-level)

Both DataList and DataTable support instance-level error tracking for fluent/chained operations. Use Err() to obtain the last error on the instance (returns *ErrorInfo or nil) and ClearErr() to clear it.

Example:

// DataList example
dl := insyra.NewDataList(1,2,3).Sort().Reverse()
if err := dl.Err(); err != nil {
    fmt.Println("Error:", err.Message)
    dl.ClearErr()
}

// DataTable example (pseudo-args shown)
dt := insyra.NewDataTable(insyra.NewDataList(1), insyra.NewDataList(2)).SortBy(/*config*/)
if err := dt.Err(); err != nil {
    fmt.Println("Error:", err.Message)
    dt.ClearErr()
}

For more details, see the DataList Documentation and DataTable Documentation.

Column Calculation Language (CCL)

Insyra features a powerful Column Calculation Language (CCL) that works just like Excel formulas!

With CCL, you can:

  • Create calculated columns using familiar Excel-like syntax
  • Reference columns using Excel-style notation (A, B, C...)
  • Use conditional logic with IF, AND, OR, and CASE functions
  • Perform mathematical operations and string manipulations
  • Execute chained comparisons like 1 < A <= 10 for range checks
  • Access specific rows using the . operator (e.g., A.0) and reference all columns with @
  • Use aggregate functions like SUM, AVG, COUNT, MAX, and MIN
// Add a column that classifies data based on values in column A
dt.AddColUsingCCL("category", "IF(A > 90, 'Excellent', IF(A > 70, 'Good', 'Average'))")

// Perform calculations just like in Excel
dt.AddColUsingCCL("total", "A + B + C")
dt.AddColUsingCCL("average", "AVG(A + B + C)")

// Use aggregate functions on rows or columns
dt.AddColUsingCCL("row_sum", "SUM(@.0)")

// Use range checks with chained comparisons (try this in Excel!)
dt.AddColUsingCCL("in_range", "IF(10 <= A <= 20, 'Yes', 'No')")
Parquet Integration

CCL can be applied directly during Parquet file reading to filter data at the source:

// Filter rows while reading - only matching rows are loaded into memory
dt, err := parquet.FilterWithCCL(ctx, "sales_data.parquet", "(['amount'] > 1000) && (['status'] = 'Active')")

// Apply CCL transformations directly on parquet files (streaming mode)
err := parquet.ApplyCCL(ctx, "data.parquet", "NEW('total') = A + B + C")

This approach reduces memory usage when working with large datasets by processing data in batches.

For a complete guide to CCL syntax and features, see the CCL Documentation.

For a complete list of DataTable methods and features, please refer to the DataTable Documentation.

Packages

Insyra also provides several expansion packages, each focusing on a specific aspect of data analysis.

isr

Provides Syntactic Sugar for Insyra. It is designed to simplify the usage of Insyra and make it more intuitive.

stats

Provides statistical functions for data analysis, including skewness, kurtosis, and moment calculations.

parallel

Offers parallel processing capabilities for data manipulation and analysis. Allows you to execute any function and automatically wait for all goroutines to complete.

plot

Provides a wrapper around the powerful github.com/go-echarts/go-echarts library, designed to simplify data visualization.

gplot

A visualization package based on github.com/gonum/plot. Fast and no need for Chrome. Even supports function plot.

csvxl

Work with Excel and CSV files. Such as convert CSV to Excel.

parquet

Provides read and write support for the Apache Parquet file format, deeply integrated with Insyra's DataTable and DataList. Supports streaming, column-level reading, and CCL filtering.

mkt

Provides marketing-related data analysis functions, such as RFM analysis. No need to worry about how to calculate, one function does it all!

py

Execute Python code in Go without manually installing Python environment and dependencies. Allows passing variables between Go and Python.

pd

Pandas-like DataFrame helpers built on top of gpandas. Provides conversion helpers between Insyra's DataTable and gpandas.DataFrame, and exposes a pandas-like API in Go. See the package docs at /Docs/pd.md and the upstream gpandas documentation: https://gpandas.apoplexi.com/docs/

datafetch

Allows you to fetch data easily. It currently includes a Google Maps store review crawler and a Yahoo Finance wrapper (powered by go-yfinance). Network access is required for remote fetchers and some features depend on third-party backends which may change.

lpgen

Provides a super simple and intuitive way to generate linear programming (LP) models and save them as .lp files. It supports setting objectives, adding constraints, defining variable bounds, and specifying binary or integer variables.

lp

Fully automatic linear programming (LP) solver using GLPK.

engine

Exports selected internal implementations from Insyra for developers to reuse in other projects.

Advanced Usage

Beyond basic usage, Insyra provides extensive capabilities for handling different data types and performing complex statistical operations. Explore more in the detailed documentation.

Contributing

Contributions are welcome! You can contribute to Insyra by:

  • Issues: Reporting issues or suggesting new features.
  • Pull Requests: Submitting pull requests to enhance the library.
  • Discussions: Sharing your feedback and ideas to improve the project.

Contributors

contributors

License

Insyra is licensed under the MIT License. See the LICENSE file for more information.

Documentation

Overview

`insyra` main package provides unified interfaces and structures for data manipulation and analysis.

Index

Constants

View Source 
const Version = "0.2.15"
View Source 
const VersionName = "Pier-2"

Variables

View Source 
var Config *configStruct = &configStruct{}
View Source 
var ReadSlice2D = Slice2DToDataTable

Alias for Slice2DToDataTable Converts a 2D slice into a DataTable. Supports various types like [][]any, [][]int, [][]float64, [][]string, etc.

View Source 
var ToFloat64 = utils.ToFloat64
View Source 
var ToFloat64Safe = utils.ToFloat64Safe

Functions

func CalcColIndex added in v0.2.13 

func CalcColIndex(colNumber int) (colIndex string, ok bool)

CalcColIndex converts a 0-based column number to its Excel-style index (A, B, C, ..., Z, AA, AB, ...).

func ClearErrors added in v0.2.2 

func ClearErrors()

func DetectEncoding added in v0.2.10 

func DetectEncoding(filePath string) (string, error)

DetectEncoding detects the character encoding of a text file. It reads a sample of the file and returns the detected charset in lower case (e.g. "utf-8", "big5", "gb-18030", "utf-16le"). For empty files it returns an error.

func GetErrorCount added in v0.2.2 

func GetErrorCount() int

func HasError added in v0.2.13 

func HasError() bool

HasError returns true if there are any errors in the buffer. This is a non-destructive check that doesn't modify the error buffer.

func HasErrorAboveLevel added in v0.2.13 

func HasErrorAboveLevel(level LogLevel) bool

HasErrorAboveLevel returns true if there are any errors at or above the specified level. This is a non-destructive check that doesn't modify the error buffer.

func IsNumeric added in v0.2.2 

func IsNumeric(v any) bool

isNumeric checks if the value is numeric.

func LogDebug 

func LogDebug(packageName, funcName, msg string, args ...any)

func LogFatal added in v0.0.1 

func LogFatal(packageName, funcName, msg string, args ...any)

func LogInfo 

func LogInfo(packageName, funcName, msg string, args ...any)

func LogWarning 

func LogWarning(packageName, funcName, msg string, args ...any)

func ParseColIndex added in v0.2.2 

func ParseColIndex(colIndex string) (colNumber int, ok bool)

ParseColIndex converts an Excel-like column name (e.g., "A", "Z", "AA") to its 0-based integer index.

func PopErrorAndCallback added in v0.2.2 

func PopErrorAndCallback(mode ErrPoppingMode, callback func(errType LogLevel, packageName string, funcName string, errMsg string))

func PowRat added in v0.0.3 

func PowRat(base *big.Rat, exponent int) *big.Rat

PowRat calculates the power of a big.Rat. 計算 big.Rat 的次方 (v^n)

func ProcessData 

func ProcessData(input any) ([]any, int)

ProcessData processes the input data and returns the data and the length of the data. Returns nil and 0 if the data type is unsupported. Supported data types are slices, IDataList, and pointers to these types.

func SetDefaultConfig 

func SetDefaultConfig()

DefaultConfig returns a Config with default values.

func Show added in v0.2.6 

func Show(label string, object showable, startEnd ...any)

Show displays the content of any showable object with a label. Automatically deals with nil objects.

func SliceToF64 

func SliceToF64(input []any) []float64

SliceToF64 converts a []any to a []float64.

func SortTimes added in v0.2.5 

func SortTimes(times []time.Time)

SortTimes sorts a slice of time.Time in ascending order. It sorts the times directly in the provided slice.

func SqrtRat 

func SqrtRat(x *big.Rat) *big.Rat

SqrtRat calculates the square root of a big.Rat. 計算 big.Rat 的平方根

Types

type DataList 

type DataList struct {
	// contains filtered or unexported fields
}

DataList is a generic dynamic data list.

func NewDataList 

func NewDataList(values ...any) *DataList

NewDataList creates a new DataList, supporting both slice and variadic inputs, and flattens the input before storing it.

func (*DataList) Append 

func (dl *DataList) Append(values ...any) *DataList

Append adds a new values to the DataList. The value can be of any type. The value is appended to the end of the DataList.

func (*DataList) AppendDataList added in v0.2.11 

func (dl *DataList) AppendDataList(other IDataList) *DataList

AppendDataList appends another DataList to the current DataList.

func (*DataList) AtomicDo added in v0.2.4 

func (s *DataList) AtomicDo(f func(*DataList))

func (*DataList) Capitalize 

func (dl *DataList) Capitalize() *DataList

Capitalize capitalizes the first letter of each string element in the DataList.

func (*DataList) Clear 

func (dl *DataList) Clear() *DataList

Clear removes all elements from the DataList and updates the timestamp.

func (*DataList) ClearErr added in v0.2.13 

func (dl *DataList) ClearErr() *DataList

ClearErr clears the last error stored in the DataList. Returns the DataList to support chaining.

func (*DataList) ClearNaNs added in v0.0.5 

func (dl *DataList) ClearNaNs() *DataList

ClearNaNs removes all NaN values from the DataList and updates the timestamp.

func (*DataList) ClearNils added in v0.2.10 

func (dl *DataList) ClearNils() *DataList

ClearNils removes all nil values from the DataList and updates the timestamp.

func (*DataList) ClearNilsAndNaNs added in v0.2.10 

func (dl *DataList) ClearNilsAndNaNs() *DataList

ClearNilsAndNaNs removes all nil and NaN values from the DataList and updates the timestamp.

func (*DataList) ClearNumbers 

func (dl *DataList) ClearNumbers() *DataList

ClearNumbers removes all numeric elements (int, float, etc.) from the DataList and updates the timestamp.

func (*DataList) ClearOutliers added in v0.0.5 

func (dl *DataList) ClearOutliers(stdDevs float64) *DataList

ClearOutliers removes values from the DataList that are outside the specified number of standard deviations. This method modifies the original DataList and returns it.

func (*DataList) ClearStrings 

func (dl *DataList) ClearStrings() *DataList

ClearStrings removes all string elements from the DataList and updates the timestamp.

func (*DataList) Clone added in v0.0.5 

func (dl *DataList) Clone() *DataList

Clone creates a deep copy of the DataList.

func (*DataList) Close added in v0.2.4 

func (s *DataList) Close()

Close ??DataList嚗???皞?

func (*DataList) Concat added in v0.2.11 

func (dl *DataList) Concat(other IDataList) *DataList

Concat creates a new DataList by concatenating another DataList to the current DataList.

func (*DataList) Count added in v0.0.1 

func (dl *DataList) Count(value any) int

Count returns the number of occurrences of the specified value in the DataList.

func (*DataList) Counter added in v0.0.12 

func (dl *DataList) Counter() map[any]int

Counter returns a map of the number of occurrences of each value in the DataList.

func (*DataList) Data 

func (dl *DataList) Data() []any

Data returns a copy of the data stored in the DataList. This prevents external modification of the internal data (Copy-on-Read).

func (*DataList) Difference added in v0.0.5 

func (dl *DataList) Difference() *DataList

Difference calculates the differences between adjacent elements in the DataList.

func (*DataList) DoubleExponentialSmoothing added in v0.0.5 

func (dl *DataList) DoubleExponentialSmoothing(alpha, beta float64) *DataList

DoubleExponentialSmoothing applies double exponential smoothing to the DataList. The alpha parameter controls the level smoothing, and the beta parameter controls the trend smoothing. Returns a new DataList containing the smoothed values.

func (*DataList) Drop 

func (dl *DataList) Drop(index int) *DataList

Drop removes the element at the specified index from the DataList and updates the timestamp. Returns an error if the index is out of bounds.

func (*DataList) DropAll 

func (dl *DataList) DropAll(toDrop ...any) *DataList

DropAll removes all occurrences of the specified values from the DataList. Supports multiple values to drop.

func (*DataList) DropIfContains added in v0.0.2 

func (dl *DataList) DropIfContains(substring string) *DataList

DropIfContains removes all elements from the DataList that contain the specified substring. This method only affects string elements. Non-string elements are kept.

func (*DataList) Err added in v0.2.13 

func (dl *DataList) Err() *ErrorInfo

Err returns the last error that occurred during a chained operation. Returns nil if no error occurred. This method allows for error checking after chained calls without breaking the chain.

Example usage: 

dl.Append(1, 2, 3).Sort().Reverse()
if err := dl.Err(); err != nil {
    // handle error
}

func (*DataList) ExponentialSmoothing added in v0.0.5 

func (dl *DataList) ExponentialSmoothing(alpha float64) *DataList

ExponentialSmoothing applies exponential smoothing to the DataList. The alpha parameter controls the smoothing factor. Returns a new DataList containing the smoothed values.

func (*DataList) FillNaNWithMean added in v0.0.5 

func (dl *DataList) FillNaNWithMean() *DataList

FillNaNWithMean replaces all NaN values in the DataList with the mean value. Directly modifies the DataList.

func (*DataList) Filter 

func (dl *DataList) Filter(filterFunc func(any) bool) *DataList

Filter filters the DataList based on a custom filter function provided by the user. The filter function should return true for elements that should be included in the result.

func (*DataList) FindAll 

func (dl *DataList) FindAll(value any) []int

FindAll returns a slice of all the indices where the specified value is found in the DataList. If the value is not found, it returns an empty slice.

func (*DataList) FindFirst 

func (dl *DataList) FindFirst(value any) any

FindFirst returns the index of the first occurrence of the specified value in the DataList. If the value is not found, it returns nil.

func (*DataList) FindLast 

func (dl *DataList) FindLast(value any) any

FindLast returns the index of the last occurrence of the specified value in the DataList. If the value is not found, it returns nil.

func (*DataList) GMean 

func (dl *DataList) GMean() float64

GMean calculates the geometric mean of the DataList. Returns the geometric mean. Returns math.NaN() if the DataList is empty or if no elements can be converted to float64.

func (*DataList) Get 

func (dl *DataList) Get(index int) any

Get retrieves the value at the specified index in the DataList. Supports negative indexing. Returns nil if the index is out of bounds. Returns the value at the specified index.

func (*DataList) GetCreationTimestamp 

func (dl *DataList) GetCreationTimestamp() int64

GetCreationTimestamp returns the creation time of the DataList in Unix timestamp.

func (*DataList) GetLastModifiedTimestamp 

func (dl *DataList) GetLastModifiedTimestamp() int64

GetLastModifiedTimestamp returns the last updated time of the DataList in Unix timestamp.

func (*DataList) GetName 

func (dl *DataList) GetName() string

GetName returns the name of the DataList.

func (*DataList) HermiteInterpolation added in v0.0.5 

func (dl *DataList) HermiteInterpolation(x float64, derivatives []float64) float64

HermiteInterpolation performs Hermite interpolation for the given x value using the DataList.

func (*DataList) IQR 

func (dl *DataList) IQR() float64

IQR calculates the interquartile range of the DataList. Returns math.NaN() if the DataList is empty or if Q1 or Q3 cannot be calculated. Returns the interquartile range (Q3 - Q1) as a float64.

func (*DataList) InsertAt 

func (dl *DataList) InsertAt(index int, value any) *DataList

InsertAt inserts a value at the specified index in the DataList. If the index is out of bounds, the value is appended to the end of the list. Returns the DataList to support chaining calls.

func (*DataList) IsEqualTo added in v0.0.12 

func (dl *DataList) IsEqualTo(anotherDl *DataList) bool

IsEqualTo checks if the data of the DataList is equal to another DataList.

func (*DataList) IsTheSameAs added in v0.0.12 

func (dl *DataList) IsTheSameAs(anotherDl *DataList) bool

IsTheSameAs checks if the DataList is fully the same as another DataList. It checks for equality in name, data, creation timestamp, and last modified timestamp.

func (*DataList) LagrangeInterpolation added in v0.0.5 

func (dl *DataList) LagrangeInterpolation(x float64) float64

LagrangeInterpolation performs Lagrange interpolation for the given x value using the DataList.

func (*DataList) Len 

func (dl *DataList) Len() int

func (*DataList) LinearInterpolation added in v0.0.5 

func (dl *DataList) LinearInterpolation(x float64) float64

LinearInterpolation performs linear interpolation for the given x value using the DataList.

func (*DataList) Lower 

func (dl *DataList) Lower() *DataList

Lower converts all string elements in the DataList to lowercase.

func (*DataList) MAD added in v0.0.5 

func (dl *DataList) MAD() float64

MAD calculates the mean absolute deviation of the DataList. Returns math.NaN() if the DataList is empty or if no valid elements can be used.

func (*DataList) Map added in v0.2.0 

func (dl *DataList) Map(mapFunc func(int, any) any) *DataList

Map applies a function to all elements in the DataList and returns a new DataList with the results. The mapFunc should take an element of any type and its index, then return a transformed value of any type.

func (*DataList) Max 

func (dl *DataList) Max() float64

Max returns the maximum value in the DataList. Returns math.NaN() if the DataList is empty or if no elements can be converted to float64.

func (*DataList) Mean 

func (dl *DataList) Mean() float64

Mean calculates the arithmetic mean of the DataList. Returns math.NaN() if the DataList is empty or if no elements can be converted to float64.

func (*DataList) Median 

func (dl *DataList) Median() float64

Median calculates the median of the DataList. Returns math.NaN() if the DataList is empty or if no valid elements can be used.

func (*DataList) Min 

func (dl *DataList) Min() float64

Min returns the minimum value in the DataList. Returns math.NaN() if the DataList is empty or if no elements can be converted to float64.

func (*DataList) Mode 

func (dl *DataList) Mode() []float64

Mode calculates the mode of the DataList. Only works with numeric data types. Mode could be a single value or multiple values. Returns nil if the DataList is empty or if no valid elements can be used.

func (*DataList) MovingAverage added in v0.0.5 

func (dl *DataList) MovingAverage(windowSize int) *DataList

MovingAverage calculates the moving average of the DataList using a specified window size. Returns a new DataList containing the moving average values.

func (*DataList) MovingStdev added in v0.0.5 

func (dl *DataList) MovingStdev(windowSize int) *DataList

MovingStdDev calculates the moving standard deviation for the DataList using a specified window size.

func (*DataList) NearestNeighborInterpolation added in v0.0.5 

func (dl *DataList) NearestNeighborInterpolation(x float64) float64

NearestNeighborInterpolation performs nearest-neighbor interpolation for the given x value using the DataList.

func (*DataList) NewtonInterpolation added in v0.0.5 

func (dl *DataList) NewtonInterpolation(x float64) float64

NewtonInterpolation performs Newton's interpolation for the given x value using the DataList.

func (*DataList) Normalize added in v0.0.5 

func (dl *DataList) Normalize() *DataList

Normalize normalizes the data in the DataList, skipping NaN values. Directly modifies the DataList.

func (*DataList) ParseNumbers 

func (dl *DataList) ParseNumbers() *DataList

ParseNumbers attempts to parse all string elements in the DataList to numeric types. If parsing fails, the element is left unchanged.

func (*DataList) ParseStrings 

func (dl *DataList) ParseStrings() *DataList

ParseStrings converts all elements in the DataList to strings.

func (*DataList) Percentile 

func (dl *DataList) Percentile(p float64) float64

Percentile calculates the percentile based on the input value (0 to 100).

func (*DataList) Pop 

func (dl *DataList) Pop() any

Pop removes and returns the last element from the DataList. Returns the last element. Returns nil if the DataList is empty.

func (*DataList) QuadraticInterpolation added in v0.0.5 

func (dl *DataList) QuadraticInterpolation(x float64) float64

QuadraticInterpolation performs quadratic interpolation for the given x value using the DataList.

func (*DataList) Quartile 

func (dl *DataList) Quartile(q int) float64

Quartile calculates the quartile based on the input value (1 to 3). 1 corresponds to the first quartile (Q1), 2 to the median (Q2), and 3 to the third quartile (Q3). This implementation uses percentiles to compute quartiles.

func (*DataList) Range 

func (dl *DataList) Range() float64

Range calculates the range of the DataList. Returns math.NaN() if the DataList is empty or if Max or Min cannot be calculated.

func (*DataList) Rank added in v0.0.4 

func (dl *DataList) Rank(ascending ...bool) *DataList

Rank assigns ranks to the elements in the DataList. By default, it ranks in ascending order (smaller value gets smaller rank). Pass false to rank in descending order.

func (*DataList) ReplaceAll 

func (dl *DataList) ReplaceAll(oldValue, newValue any) *DataList

ReplaceAll replaces all occurrences of oldValue with newValue in the DataList. If oldValue is not found, no changes are made.

func (*DataList) ReplaceFirst 

func (dl *DataList) ReplaceFirst(oldValue, newValue any) *DataList

ReplaceFirst replaces the first occurrence of oldValue with newValue.

func (*DataList) ReplaceLast 

func (dl *DataList) ReplaceLast(oldValue, newValue any) *DataList

ReplaceLast replaces the last occurrence of oldValue with newValue.

func (*DataList) ReplaceNaNsAndNilsWith added in v0.2.10 

func (dl *DataList) ReplaceNaNsAndNilsWith(value any) *DataList

ReplaceNaNsAndNilsWith replaces all NaN and nil values in the DataList with the specified value.

func (*DataList) ReplaceNaNsWith added in v0.2.10 

func (dl *DataList) ReplaceNaNsWith(value any) *DataList

ReplaceNaNsWith replaces all NaN values in the DataList with the specified value.

func (*DataList) ReplaceNilsWith added in v0.2.10 

func (dl *DataList) ReplaceNilsWith(value any) *DataList

ReplaceNilsWith replaces all nil values in the DataList with the specified value.

func (*DataList) ReplaceOutliers added in v0.0.5 

func (dl *DataList) ReplaceOutliers(stdDevs float64, replacement float64) *DataList

ReplaceOutliers replaces outliers in the DataList with the specified replacement value (e.g., mean, median).

Parameters: - stdDevs: Number of standard deviations to use as threshold (e.g., 2.0 means values beyond ±2σ from the mean will be replaced) - replacement: Value to replace outliers with

func (*DataList) Reverse 

func (dl *DataList) Reverse() *DataList

Reverse reverses the order of the elements in the DataList.

func (*DataList) SetName 

func (dl *DataList) SetName(newName string) *DataList

SetName sets the name of the DataList.

func (*DataList) Show added in v0.2.0 

func (dl *DataList) Show()

Show displays the content of DataList in a clean linear format. It adapts to terminal width and always displays in a linear format, not as a table. For more control over which items to display, use ShowRange.

func (*DataList) ShowRange added in v0.2.0 

func (dl *DataList) ShowRange(startEnd ...any)

ShowRange displays the content of DataList within a specified range in a clean linear format. It adapts to terminal width and always displays in a linear format, not as a table. startEnd is an optional parameter that can be [start, end] to specify the range of items to display. if startEnd is not provided, all items will be displayed. if only one value is provided, there are two behaviors: - if positive, it shows the first N items (e.g., ShowRange(5) shows first 5 items) - if negative, it shows the last N items (e.g., ShowRange(-5) shows last 5 items) For two parameters [start, end], it shows items from index start (inclusive) to index end (exclusive). If end is nil, it shows items from index start to the end of the list. Example: dl.ShowRange() - shows all items Example: dl.ShowRange(5) - shows the first 5 items Example: dl.ShowRange(-5) - shows the last 5 items Example: dl.ShowRange(2, 10) - shows items with indices 2 to 9 (not including 10) Example: dl.ShowRange(2, -1) - shows items from index 2 to the end of the list Example: dl.ShowRange(2, nil) - shows items from index 2 to the end of the list

func (*DataList) ShowTypes added in v0.2.0 

func (dl *DataList) ShowTypes()

ShowTypes displays the data types of each element in the DataList. It adapts to terminal width and always displays in a linear format.

func (*DataList) ShowTypesRange added in v0.2.0 

func (dl *DataList) ShowTypesRange(startEnd ...any)

ShowTypesRange displays the data types of DataList within a specified range. startEnd 参数同 ShowRange。

func (*DataList) Sort 

func (dl *DataList) Sort(ascending ...bool) *DataList

Sort sorts the DataList using a mixed sorting logic. It handles string, numeric (including all integer and float types), and time data types. If sorting fails, it restores the original order.

func (*DataList) Standardize added in v0.0.5 

func (dl *DataList) Standardize() *DataList

Standardize standardizes the data in the DataList. Directly modifies the DataList.

func (*DataList) Stdev 

func (dl *DataList) Stdev() float64

Stdev calculates the standard deviation (sample) of the DataList. Returns math.NaN() if the DataList is empty or if no valid elements can be used.

func (*DataList) StdevP 

func (dl *DataList) StdevP() float64

StdevP calculates the standard deviation (population) of the DataList. Returns math.NaN() if the DataList is empty or if no valid elements can be used.

func (*DataList) Sum added in v0.0.1 

func (dl *DataList) Sum() float64

Sum calculates the sum of all elements in the DataList. Returns math.NaN() if the DataList is empty or if no elements can be converted to float64.

func (*DataList) Summary added in v0.2.0 

func (dl *DataList) Summary()

Summary displays a comprehensive statistical summary of the DataList directly to the console.

func (*DataList) ToF64Slice 

func (dl *DataList) ToF64Slice() []float64

ToF64Slice converts the DataList to a float64 slice. Returns the float64 slice. Returns nil if the DataList is empty. ToF64Slice converts the DataList to a float64 slice.

func (*DataList) ToStringSlice 

func (dl *DataList) ToStringSlice() []string

ToStringSlice converts the DataList to a string slice. Returns the string slice. Returns nil if the DataList is empty.

func (*DataList) Update 

func (dl *DataList) Update(index int, newValue any) *DataList

Update replaces the value at the specified index with the new value. Returns the DataList to support chaining calls.

func (*DataList) Upper 

func (dl *DataList) Upper() *DataList

Upper converts all string elements in the DataList to uppercase.

func (*DataList) Var 

func (dl *DataList) Var() float64

Var calculates the variance (sample variance) of the DataList. Returns math.NaN() if the DataList is empty or if not enough valid elements are available.

func (*DataList) VarP 

func (dl *DataList) VarP() float64

VarP calculates the variance (population variance) of the DataList. Returns math.NaN() if the DataList is empty or if no valid elements can be used.

func (*DataList) WeightedMean added in v0.0.5 

func (dl *DataList) WeightedMean(weights any) float64

WeightedMean calculates the weighted mean of the DataList using the provided weights. The weights parameter should be a slice or a DataList of the same length as the DataList. Returns math.NaN() if the DataList is empty, weights are invalid, or if no valid elements can be used.

func (*DataList) WeightedMovingAverage added in v0.0.5 

func (dl *DataList) WeightedMovingAverage(windowSize int, weights any) *DataList

WeightedMovingAverage applies a weighted moving average to the DataList with a given window size. The weights parameter should be a slice or a DataList of the same length as the window size. Returns a new DataList containing the weighted moving average values.

type DataTable added in v0.0.1 

type DataTable struct {
	// contains filtered or unexported fields
}

DataTable is the core data structure of Insyra for handling structured data. It provides rich data manipulation functionality including reading, writing, filtering, statistical analysis, and transformation operations.

DataTable uses a columnar storage format where each column is represented by a DataList. It supports both alphabetical column indexing (A, B, C...) and named columns, as well as row naming capabilities.

Key features: - Thread-safe operations via AtomicDo - Flexible data types using any - Column and row indexing/naming - Comprehensive data manipulation methods - CSV/JSON/SQL import/export capabilities

func NewDataTable added in v0.0.1 

func NewDataTable(columns ...*DataList) *DataTable

func ReadCSV_File added in v0.2.9 

func ReadCSV_File(filePath string, setFirstColToRowNames bool, setFirstRowToColNames bool, encoding ...string) (*DataTable, error)

ReadCSV_File loads a CSV file into a DataTable, with options to set the first column as row names and the first row as column names.

func ReadCSV_String added in v0.2.4 

func ReadCSV_String(csvString string, setFirstColToRowNames bool, setFirstRowToColNames bool) (*DataTable, error)

func ReadExcelSheet added in v0.2.10 

func ReadExcelSheet(filePath string, sheetName string, setFirstColToRowNames bool, setFirstRowToColNames bool) (*DataTable, error)

ReadExcelSheet reads a specific sheet from an Excel file and loads it into a DataTable.

func ReadJSON added in v0.2.4 

func ReadJSON(data any) (*DataTable, error)

func ReadJSON_File added in v0.2.9 

func ReadJSON_File(filePath string) (*DataTable, error)

ReadJSON_File reads a JSON file and loads the data into a DataTable and returns it.

func ReadSQL added in v0.2.0 

func ReadSQL(db *gorm.DB, tableName string, options ...ReadSQLOptions) (*DataTable, error)

ReadSQL reads table data from the database and converts it into a DataTable object. If a custom Query is provided in options, it will use the custom query. Otherwise, it uses tableName and other options to construct the SQL query.

func Slice2DToDataTable added in v0.2.7 

func Slice2DToDataTable(data any) (*DataTable, error)

Slice2DToDataTable converts a 2D slice of any type into a DataTable. It supports various 2D array types such as [][]any, [][]int, [][]float64, [][]string, etc.

func (*DataTable) AddColUsingCCL added in v0.2.2 

func (dt *DataTable) AddColUsingCCL(newColName, cclFormula string) *DataTable

func (*DataTable) AppendCols added in v0.0.14 

func (dt *DataTable) AppendCols(columns ...*DataList) *DataTable

AppendCols appends columns to the DataTable, with each column represented by a DataList. If the columns are shorter than the existing columns, nil values will be appended to match the length. If the columns are longer than the existing columns, the existing columns will be extended with nil values.

func (*DataTable) AppendRowsByColIndex added in v0.0.14 

func (dt *DataTable) AppendRowsByColIndex(rowsData ...map[string]any) *DataTable

AppendRowsByIndex appends rows to the DataTable, with each row represented by a map of column index and value. If the rows are shorter than the existing columns, nil values will be appended to match the length. If the rows are longer than the existing columns, the existing columns will be extended with nil values.

func (*DataTable) AppendRowsByColName added in v0.0.14 

func (dt *DataTable) AppendRowsByColName(rowsData ...map[string]any) *DataTable

AppendRowsByName appends rows to the DataTable, with each row represented by a map of column name and value. If the rows are shorter than the existing columns, nil values will be appended to match the length. If the rows are longer than the existing columns, the existing columns will be extended with nil values.

func (*DataTable) AppendRowsFromDataList added in v0.0.1 

func (dt *DataTable) AppendRowsFromDataList(rowsData ...*DataList) *DataTable

AppendRowsFromDataList appends rows to the DataTable, with each row represented by a DataList. If the rows are shorter than the existing columns, nil values will be appended to match the length. If the rows are longer than the existing columns, the existing columns will be extended with nil values.

func (*DataTable) AtomicDo added in v0.2.4 

func (dt *DataTable) AtomicDo(f func(*DataTable))

func (*DataTable) ChangeColName added in v0.2.2 

func (dt *DataTable) ChangeColName(oldName, newName string) *DataTable

func (*DataTable) ChangeRowName added in v0.2.2 

func (dt *DataTable) ChangeRowName(oldName, newName string) *DataTable

ChangeRowName changes the name of a row from oldName to newName. Parameters:

  • oldName: The current name of the row.
  • newName: The new name to set for the row.

Returns:

  • *DataTable: The DataTable instance for chaining.

func (*DataTable) ClearErr added in v0.2.13 

func (dt *DataTable) ClearErr() *DataTable

ClearErr clears the last error stored in the DataTable. Returns the DataTable to support chaining.

func (*DataTable) Clone added in v0.2.5 

func (dt *DataTable) Clone() *DataTable

Clone creates a deep copy of the DataTable. It copies all columns, column indices, row names, and metadata, ensuring that modifications to the original DataTable do not affect the clone. The cloned DataTable has a new creation timestamp and is fully independent.

func (*DataTable) Close added in v0.2.4 

func (dt *DataTable) Close()

Close ??DataTable嚗???皞?

func (*DataTable) ColNames added in v0.2.4 

func (dt *DataTable) ColNames() []string

func (*DataTable) ColNamesToFirstRow added in v0.2.4 

func (dt *DataTable) ColNamesToFirstRow() *DataTable

func (*DataTable) Count added in v0.0.4 

func (dt *DataTable) Count(value any) int

Count returns the number of occurrences of the given value in the DataTable.

func (*DataTable) Counter added in v0.0.14 

func (dt *DataTable) Counter() map[any]int

Counter returns the number of occurrences of the given value in the DataTable. Return a map[any]int

func (*DataTable) Data added in v0.0.1 

func (dt *DataTable) Data(useNamesAsKeys ...bool) map[string][]any

func (*DataTable) DropColNames added in v0.2.4 

func (dt *DataTable) DropColNames() *DataTable

func (*DataTable) DropColsByIndex added in v0.0.14 

func (dt *DataTable) DropColsByIndex(columnIndices ...string) *DataTable

DropColsByIndex drops columns by their index names.

func (*DataTable) DropColsByName added in v0.0.14 

func (dt *DataTable) DropColsByName(columnNames ...string) *DataTable

DropColsByName drops columns by their names.

func (*DataTable) DropColsByNumber added in v0.0.14 

func (dt *DataTable) DropColsByNumber(columnIndices ...int) *DataTable

DropColsByNumber drops columns by their number.

func (*DataTable) DropColsContain added in v0.2.6 

func (dt *DataTable) DropColsContain(value ...any) *DataTable

DropColsContain drops columns that contain the specified value.

func (*DataTable) DropColsContainExcelNA added in v0.2.6 

func (dt *DataTable) DropColsContainExcelNA() *DataTable

DropColsContainExcelNA drops columns that contain Excel NA values ("#N/A").

func (*DataTable) DropColsContainNaN added in v0.2.10 

func (dt *DataTable) DropColsContainNaN() *DataTable

DropColsContainNaN drops columns that contain NaN (Not a Number) elements.

func (*DataTable) DropColsContainNil added in v0.0.14 

func (dt *DataTable) DropColsContainNil() *DataTable

DropColsContainNil drops columns that contain nil elements.

func (*DataTable) DropColsContainNumber added in v0.2.10 

func (dt *DataTable) DropColsContainNumber() *DataTable

DropColsContainNumber drops columns that contain number elements.

func (*DataTable) DropColsContainString added in v0.2.10 

func (dt *DataTable) DropColsContainString() *DataTable

DropColsContainString drops columns that contain string elements.

func (*DataTable) DropRowNames added in v0.2.4 

func (dt *DataTable) DropRowNames() *DataTable

DropRowNames removes all row names from the DataTable. Returns:

  • *DataTable: The DataTable instance for chaining.

func (*DataTable) DropRowsByIndex added in v0.0.1 

func (dt *DataTable) DropRowsByIndex(rowIndices ...int) *DataTable

DropRowsByIndex drops rows by their indices.

func (*DataTable) DropRowsByName added in v0.0.1 

func (dt *DataTable) DropRowsByName(rowNames ...string) *DataTable

DropRowsByName drops rows by their names.

func (*DataTable) DropRowsContain added in v0.2.6 

func (dt *DataTable) DropRowsContain(value ...any) *DataTable

DropRowsContain drops rows that contain the specified value.

func (*DataTable) DropRowsContainExcelNA added in v0.2.6 

func (dt *DataTable) DropRowsContainExcelNA() *DataTable

DropRowsContainExcelNA drops rows that contain Excel NA values ("#N/A").

func (*DataTable) DropRowsContainNaN added in v0.2.10 

func (dt *DataTable) DropRowsContainNaN() *DataTable

DropRowsContainNaN drops rows that contain NaN (Not a Number) elements.

func (*DataTable) DropRowsContainNil added in v0.0.2 

func (dt *DataTable) DropRowsContainNil() *DataTable

DropRowsContainNil drops rows that contain nil elements.

func (*DataTable) DropRowsContainNumber added in v0.2.10 

func (dt *DataTable) DropRowsContainNumber() *DataTable

DropRowsContainNumber drops rows that contain number elements.

func (*DataTable) DropRowsContainString added in v0.2.10 

func (dt *DataTable) DropRowsContainString() *DataTable

DropRowsContainString drops rows that contain string elements.

func (*DataTable) EditColByIndexUsingCCL added in v0.2.9 

func (dt *DataTable) EditColByIndexUsingCCL(colIndex, cclFormula string) *DataTable

EditColByIndexUsingCCL modifies an existing column at the specified index using a CCL expression. The column index uses Excel-style letters (A, B, C, ..., AA, AB, etc.) where A = first column. Returns the modified DataTable.

func (*DataTable) EditColByNameUsingCCL added in v0.2.9 

func (dt *DataTable) EditColByNameUsingCCL(colName, cclFormula string) *DataTable

EditColByNameUsingCCL modifies an existing column with the specified name using a CCL expression. Returns the modified DataTable. If the column name is not found, a warning is logged.

func (*DataTable) Err added in v0.2.13 

func (dt *DataTable) Err() *ErrorInfo

Err returns the last error that occurred during a chained operation. Returns nil if no error occurred. This method allows for error checking after chained calls without breaking the chain.

Example usage: 

dt.Replace(old, new).ReplaceNaNsWith(0).SortBy(config)
if err := dt.Err(); err != nil {
    // handle error
}

func (*DataTable) ExecuteCCL added in v0.2.9 

func (dt *DataTable) ExecuteCCL(cclStatements string) *DataTable

ExecuteCCL executes multi-line CCL statements on the DataTable. It supports assignment syntax (e.g., A=B+C) and NEW('colName', expr) for creating new columns. Multiple statements can be separated by ; or newline. Assignment operations modify existing columns; if the target column doesn't exist, an error is returned. Returns the modified DataTable.

func (*DataTable) Filter added in v0.0.2 

func (dt *DataTable) Filter(filterFunc func(rowIndex int, columnIndex string, value any) bool) *DataTable

Filter applies a custom filter function to the DataTable and returns the filtered DataTable.

func (*DataTable) FilterByCustomElement added in v0.0.2 

func (dt *DataTable) FilterByCustomElement(filterFunc func(value any) bool) *DataTable

FilterByCustomElement filters the table based on a custom function applied to each element.

func (*DataTable) FilterCols added in v0.2.9 

func (dt *DataTable) FilterCols(filterFunc func(rowIndex int, rowName string, x any) bool) *DataTable

FilterCols applies a custom filter function to each cell in every column and returns a new DataTable that only contains columns where the filter function returns true for at least one cell in that column.

The filter function receives: - rowIndex: index of the row - rowName: name of the row (empty if none) - x: the cell value

func (*DataTable) FilterColsByColIndexEqualTo added in v0.2.9 

func (dt *DataTable) FilterColsByColIndexEqualTo(columnIndexLetter string) *DataTable

FilterColsByColIndexEqualTo filters to only keep the column with the specified index.

func (*DataTable) FilterColsByColIndexGreaterThan added in v0.2.9 

func (dt *DataTable) FilterColsByColIndexGreaterThan(columnIndexLetter string) *DataTable

FilterColsByColIndexGreaterThan filters columns with index greater than the specified column.

func (*DataTable) FilterColsByColIndexGreaterThanOrEqualTo added in v0.2.9 

func (dt *DataTable) FilterColsByColIndexGreaterThanOrEqualTo(columnIndexLetter string) *DataTable

FilterColsByColIndexGreaterThanOrEqualTo filters columns with index greater than or equal to the specified column.

func (*DataTable) FilterColsByColIndexLessThan added in v0.2.9 

func (dt *DataTable) FilterColsByColIndexLessThan(columnIndexLetter string) *DataTable

FilterColsByColIndexLessThan filters columns with index less than the specified column.

func (*DataTable) FilterColsByColIndexLessThanOrEqualTo added in v0.2.9 

func (dt *DataTable) FilterColsByColIndexLessThanOrEqualTo(columnIndexLetter string) *DataTable

FilterColsByColIndexLessThanOrEqualTo filters columns with index less than or equal to the specified column.

func (*DataTable) FilterColsByColNameContains added in v0.2.9 

func (dt *DataTable) FilterColsByColNameContains(substring string) *DataTable

FilterColsByColNameContains filters columns whose name contains the specified substring.

func (*DataTable) FilterColsByColNameEqualTo added in v0.2.9 

func (dt *DataTable) FilterColsByColNameEqualTo(columnName string) *DataTable

FilterColsByColNameEqualTo filters to only keep the column with the specified name.

func (*DataTable) FilterRows added in v0.2.9 

func (dt *DataTable) FilterRows(filterFunc func(colIndex, colName string, x any) bool) *DataTable

FilterRows applies a custom filter function to each cell in the DataTable and keeps only rows where the filter function returns true for at least one cell. The filter function receives: colindex (column letter), colname (column name), and x (cell value).

func (*DataTable) FilterRowsByRowIndexEqualTo added in v0.2.9 

func (dt *DataTable) FilterRowsByRowIndexEqualTo(index int) *DataTable

FilterRowsByRowIndexEqualTo filters to only keep the row with the specified index.

func (*DataTable) FilterRowsByRowIndexGreaterThan added in v0.2.9 

func (dt *DataTable) FilterRowsByRowIndexGreaterThan(threshold int) *DataTable

FilterRowsByRowIndexGreaterThan filters rows with index greater than the specified threshold.

func (*DataTable) FilterRowsByRowIndexGreaterThanOrEqualTo added in v0.2.9 

func (dt *DataTable) FilterRowsByRowIndexGreaterThanOrEqualTo(threshold int) *DataTable

FilterRowsByRowIndexGreaterThanOrEqualTo filters rows with index greater than or equal to the specified threshold.

func (*DataTable) FilterRowsByRowIndexLessThan added in v0.2.9 

func (dt *DataTable) FilterRowsByRowIndexLessThan(threshold int) *DataTable

FilterRowsByRowIndexLessThan filters rows with index less than the specified threshold.

func (*DataTable) FilterRowsByRowIndexLessThanOrEqualTo added in v0.2.9 

func (dt *DataTable) FilterRowsByRowIndexLessThanOrEqualTo(threshold int) *DataTable

FilterRowsByRowIndexLessThanOrEqualTo filters rows with index less than or equal to the specified threshold.

func (*DataTable) FilterRowsByRowNameContains added in v0.2.9 

func (dt *DataTable) FilterRowsByRowNameContains(substring string) *DataTable

FilterRowsByRowNameContains filters rows whose name contains the specified substring.

func (*DataTable) FilterRowsByRowNameEqualTo added in v0.2.9 

func (dt *DataTable) FilterRowsByRowNameEqualTo(rowName string) *DataTable

FilterRowsByRowNameEqualTo filters to only keep the row with the specified name.

func (*DataTable) FindColsIfAllElementsContainSubstring added in v0.0.14 

func (dt *DataTable) FindColsIfAllElementsContainSubstring(substring string) []string

FindColsIfAllElementsContainSubstring returns the indices of columns that contain all elements that contain the given substring.

func (*DataTable) FindColsIfAnyElementContainsSubstring added in v0.0.14 

func (dt *DataTable) FindColsIfAnyElementContainsSubstring(substring string) []string

FindColsIfAnyElementContainsSubstring returns the indices of columns that contain at least one element that contains the given substring.

func (*DataTable) FindColsIfContains added in v0.0.14 

func (dt *DataTable) FindColsIfContains(value any) []string

FindColsIfContains returns the indices of columns that contain the given element.

func (*DataTable) FindColsIfContainsAll added in v0.0.14 

func (dt *DataTable) FindColsIfContainsAll(values ...any) []string

FindColsIfContainsAll returns the indices of columns that contain all the given elements.

func (*DataTable) FindRowsIfAllElementsContainSubstring added in v0.0.2 

func (dt *DataTable) FindRowsIfAllElementsContainSubstring(substring string) []int

FindRowsIfAllElementsContainSubstring returns the indices of rows that contain all elements that contain the given substring.

func (*DataTable) FindRowsIfAnyElementContainsSubstring added in v0.0.2 

func (dt *DataTable) FindRowsIfAnyElementContainsSubstring(substring string) []int

FindRowsIfAnyElementContainsSubstring returns the indices of rows that contain at least one element that contains the given substring.

func (*DataTable) FindRowsIfContains added in v0.0.2 

func (dt *DataTable) FindRowsIfContains(value any) []int

FindRowsIfContains returns the indices of rows that contain the given element.

func (*DataTable) FindRowsIfContainsAll added in v0.0.2 

func (dt *DataTable) FindRowsIfContainsAll(values ...any) []int

FindRowsIfContainsAll returns the indices of rows that contain all the given elements.

func (*DataTable) GetCol added in v0.0.14 

func (dt *DataTable) GetCol(index string) *DataList

GetCol returns a new DataList containing the data of the column with the given index.

func (*DataTable) GetColByName added in v0.2.2 

func (dt *DataTable) GetColByName(name string) *DataList

func (*DataTable) GetColByNumber added in v0.0.14 

func (dt *DataTable) GetColByNumber(index int) *DataList

func (*DataTable) GetColIndexByName added in v0.2.4 

func (dt *DataTable) GetColIndexByName(name string) string

GetColIndexByName returns the column index (A, B, C, ...) by its name.

func (*DataTable) GetColIndexByNumber added in v0.2.4 

func (dt *DataTable) GetColIndexByNumber(number int) string

GetColIndexByNumber returns the column index (A, B, C, ...) by its number (0, 1, 2, ...).

func (*DataTable) GetColNameByIndex added in v0.2.4 

func (dt *DataTable) GetColNameByIndex(index string) string

GetColNameByIndex gets the column name by its Excel-style index (A, B, C, ..., Z, AA, AB, ...).

func (*DataTable) GetColNameByNumber added in v0.2.2 

func (dt *DataTable) GetColNameByNumber(index int) string

func (*DataTable) GetColNumberByName added in v0.2.4 

func (dt *DataTable) GetColNumberByName(name string) int

func (*DataTable) GetCreationTimestamp added in v0.0.1 

func (dt *DataTable) GetCreationTimestamp() int64

func (*DataTable) GetElement added in v0.0.2 

func (dt *DataTable) GetElement(rowIndex int, columnIndex string) any

GetElement returns the element at the given row and column index.

func (*DataTable) GetElementByNumberIndex added in v0.0.7 

func (dt *DataTable) GetElementByNumberIndex(rowIndex int, columnIndex int) any

func (*DataTable) GetLastModifiedTimestamp added in v0.0.1 

func (dt *DataTable) GetLastModifiedTimestamp() int64

func (*DataTable) GetName added in v0.2.0 

func (dt *DataTable) GetName() string

GetName returns the name of the DataTable.

func (*DataTable) GetRow added in v0.0.2 

func (dt *DataTable) GetRow(index int) *DataList

GetRow returns a new DataList containing the data of the row with the given index.

func (*DataTable) GetRowByName added in v0.2.2 

func (dt *DataTable) GetRowByName(name string) *DataList

func (*DataTable) GetRowIndexByName added in v0.2.10 

func (dt *DataTable) GetRowIndexByName(name string) (int, bool)

GetRowIndexByName returns the index of the row with the given name. Parameters:

  • name: The name of the row to find.

Returns:

  • int: The row index (0-based). Returns -1 if the row name does not exist.
  • bool: true if the row name exists, false otherwise.

Note: 

Since Insyra's Get methods usually support -1 as an index (representing the last element),
always check the boolean return value to distinguish between "name not found" and "last row".

Example: 

index, exists := dt.GetRowIndexByName("MyRow")
if exists {
    row := dt.GetRow(index)
}

func (*DataTable) GetRowNameByIndex added in v0.0.2 

func (dt *DataTable) GetRowNameByIndex(index int) (string, bool)

GetRowNameByIndex returns the name of the row at the given index. Parameters:

  • index: The row index (0-based). Supports negative indices (e.g., -1 for the last row).

Returns:

  • string: The name of the row. Returns empty string if no name is set for this row.
  • bool: true if a row name exists for this index, false otherwise.

Example: 

name, exists := dt.GetRowNameByIndex(0)
if exists {
    fmt.Println("Row name:", name)
}

func (*DataTable) Headers added in v0.2.5 

func (dt *DataTable) Headers() []string

Headers is an alias for ColNames, returning the column names of the DataTable.

func (*DataTable) Map added in v0.2.0 

func (dt *DataTable) Map(mapFunc func(rowIndex int, colIndex string, element any) any) *DataTable

Map applies a function to all elements in the DataTable and returns a new DataTable with the results. The mapFunc should take three parameters: row index (int), column index (string), and element (any), then return a transformed value of any type.

func (*DataTable) Mean added in v0.0.7 

func (dt *DataTable) Mean() any

Mean returns the mean of the DataTable.

func (*DataTable) Merge added in v0.2.11 

func (dt *DataTable) Merge(other IDataTable, direction MergeDirection, mode MergeMode, on ...string) (*DataTable, error)

Merge merges two DataTables based on a key column or row name. direction: MergeDirectionHorizontal (join columns) or MergeDirectionVertical (join rows) mode: MergeModeInner, MergeModeOuter, MergeModeLeft, or MergeModeRight on: (Optional) the name of the column to join on (for horizontal). If empty or omitted, uses row names.

func (*DataTable) NumCols added in v0.2.11 

func (dt *DataTable) NumCols() int

func (*DataTable) NumRows added in v0.2.11 

func (dt *DataTable) NumRows() int

func (*DataTable) Replace added in v0.2.11 

func (dt *DataTable) Replace(oldValue, newValue any) *DataTable

Replace all occurrences of oldValue with newValue in the DataTable.

func (*DataTable) ReplaceInCol added in v0.2.11 

func (dt *DataTable) ReplaceInCol(colIndex string, oldValue, newValue any, mode ...int) *DataTable

Replace occurrences of oldValue with newValue in a specific column of the DataTable.

Parameters

  • colIndex: The index or name of the column to perform replacements in.
  • oldValue: The value to be replaced.
  • newValue: The value to replace with.
  • mode (optional): An integer indicating the replacement mode.
  • 0 (default): Replace all occurrences.
  • 1: Replace only the first occurrence.
  • -1: Replace only the last occurrence.

func (*DataTable) ReplaceInRow added in v0.2.11 

func (dt *DataTable) ReplaceInRow(rowIndex int, oldValue, newValue any, mode ...int) *DataTable

Replace occurrences of oldValue with newValue in a specific row of the DataTable.

Parameters

  • rowIndex: The index of the row to perform replacements in.
  • oldValue: The value to be replaced.
  • newValue: The value to replace with.
  • mode (optional): An integer indicating the replacement mode.
  • 0 (default): Replace all occurrences.
  • 1: Replace only the first occurrence.
  • -1: Replace only the last occurrence.

func (*DataTable) ReplaceNaNsAndNilsInCol added in v0.2.11 

func (dt *DataTable) ReplaceNaNsAndNilsInCol(colIndex string, newValue any, mode ...int) *DataTable

ReplaceNaNsAndNilsInCol replaces occurrences of NaN and nil with newValue in a specific column of the DataTable.

Parameters

  • colIndex: The index of the column to perform replacements in.
  • newValue: The value to replace NaNs and nils with.
  • mode (optional): An integer indicating the replacement mode.
  • 0 (default): Replace all occurrences.
  • 1: Replace only the first occurrence.
  • -1: Replace only the last occurrence.

func (*DataTable) ReplaceNaNsAndNilsInRow added in v0.2.11 

func (dt *DataTable) ReplaceNaNsAndNilsInRow(rowIndex int, newValue any, mode ...int) *DataTable

Replace occurrences of NaN and nil with newValue in a specific row of the DataTable.

Parameters

  • rowIndex: The index of the row to perform replacements in.
  • newValue: The value to replace NaNs and nils with.
  • mode (optional): An integer indicating the replacement mode.
  • 0 (default): Replace all occurrences.
  • 1: Replace only the first occurrence.
  • -1: Replace only the last occurrence.

func (*DataTable) ReplaceNaNsAndNilsWith added in v0.2.11 

func (dt *DataTable) ReplaceNaNsAndNilsWith(newValue any) *DataTable

Replace all occurrences of NaN and nil with newValue in the DataTable.

func (*DataTable) ReplaceNaNsInCol added in v0.2.11 

func (dt *DataTable) ReplaceNaNsInCol(colIndex string, newValue any, mode ...int) *DataTable

Replace occurrences of NaN with newValue in a specific column of the DataTable.

Parameters

  • colIndex: The index or name of the column to perform replacements in.
  • newValue: The value to replace NaNs with.
  • mode (optional): An integer indicating the replacement mode.
  • 0 (default): Replace all occurrences.
  • 1: Replace only the first occurrence.
  • -1: Replace only the last occurrence.

func (*DataTable) ReplaceNaNsInRow added in v0.2.11 

func (dt *DataTable) ReplaceNaNsInRow(rowIndex int, newValue any, mode ...int) *DataTable

Replace occurrences of NaN with newValue in a specific row of the DataTable.

Parameters

  • rowIndex: The index of the row to perform replacements in.
  • newValue: The value to replace NaNs with.
  • mode (optional): An integer indicating the replacement mode.
  • 0 (default): Replace all occurrences.
  • 1: Replace only the first occurrence.
  • -1: Replace only the last occurrence.

func (*DataTable) ReplaceNaNsWith added in v0.2.11 

func (dt *DataTable) ReplaceNaNsWith(newValue any) *DataTable

Replace all occurrences of NaN with newValue in the DataTable.

func (*DataTable) ReplaceNilsInCol added in v0.2.11 

func (dt *DataTable) ReplaceNilsInCol(colIndex string, newValue any, mode ...int) *DataTable

ReplaceNilsInCol replaces occurrences of nil with newValue in a specific column of the DataTable.

Parameters

  • colIndex: The index of the column to perform replacements in.
  • newValue: The value to replace nils with.
  • mode (optional): An integer indicating the replacement mode.
  • 0 (default): Replace all occurrences.
  • 1: Replace only the first occurrence.
  • -1: Replace only the last occurrence.

func (*DataTable) ReplaceNilsInRow added in v0.2.11 

func (dt *DataTable) ReplaceNilsInRow(rowIndex int, newValue any, mode ...int) *DataTable

Replace occurrences of nil with newValue in a specific row of the DataTable.

Parameters

  • rowIndex: The index of the row to perform replacements in.
  • newValue: The value to replace nils with.
  • mode (optional): An integer indicating the replacement mode.
  • 0 (default): Replace all occurrences.
  • 1: Replace only the first occurrence.
  • -1: Replace only the last occurrence.

func (*DataTable) ReplaceNilsWith added in v0.2.11 

func (dt *DataTable) ReplaceNilsWith(newValue any) *DataTable

Replace all occurrences of nil with newValue in the DataTable.

func (*DataTable) RowNames added in v0.2.4 

func (dt *DataTable) RowNames() []string

RowNames returns a slice of all row names in the DataTable. Rows without names will have an empty string. Returns:

  • []string: A slice containing the names of all rows.

func (*DataTable) RowNamesToFirstCol added in v0.2.4 

func (dt *DataTable) RowNamesToFirstCol() *DataTable

RowNamesToFirstCol moves the row names to the first column of the DataTable. This will clear the row names map and insert a new column at the beginning. Returns:

  • *DataTable: The DataTable instance for chaining.

func (*DataTable) SetColNameByIndex added in v0.2.2 

func (dt *DataTable) SetColNameByIndex(index string, name string) *DataTable

func (*DataTable) SetColNameByNumber added in v0.2.2 

func (dt *DataTable) SetColNameByNumber(numberIndex int, name string) *DataTable

func (*DataTable) SetColNames added in v0.2.5 

func (dt *DataTable) SetColNames(colNames []string) *DataTable

func (*DataTable) SetColToRowNames added in v0.0.14 

func (dt *DataTable) SetColToRowNames(columnIndex string) *DataTable

SetColToRowNames sets the row names to the values of the specified column and drops the column.

func (*DataTable) SetHeaders added in v0.2.5 

func (dt *DataTable) SetHeaders(headers []string) *DataTable

SetHeaders is an alias for SetColNames, setting the column names of the DataTable.

func (*DataTable) SetName added in v0.2.0 

func (dt *DataTable) SetName(name string) *DataTable

SetName sets the name of the DataTable.

func (*DataTable) SetRowNameByIndex added in v0.0.2 

func (dt *DataTable) SetRowNameByIndex(index int, name string) *DataTable

SetRowNameByIndex sets the name of the row at the given index. Parameters:

  • index: The row index (0-based). Supports negative indices (e.g., -1 for the last row).
  • name: The name to set for the row. If empty, the row name is removed.

Returns:

  • *DataTable: The DataTable instance for chaining.

Example: 

dt.SetRowNameByIndex(0, "FirstRow")

func (*DataTable) SetRowNames added in v0.2.5 

func (dt *DataTable) SetRowNames(rowNames []string) *DataTable

SetRowNames sets the row names of the DataTable. Different from SetColNames, it only sets names for existing rows.

func (*DataTable) SetRowToColNames added in v0.0.14 

func (dt *DataTable) SetRowToColNames(rowIndex int) *DataTable

SetRowToColNames sets the column names to the values of the specified row and drops the row.

func (*DataTable) Show added in v0.0.1 

func (dt *DataTable) Show()

Show displays the content of the DataTable in a formatted way. For more control over which rows to display, use ShowRange.

func (*DataTable) ShowRange added in v0.2.0 

func (dt *DataTable) ShowRange(startEnd ...any)

ShowRange displays the DataTable with a specified range of rows. startEnd is an optional parameter that can be [start, end] to specify the range of rows to display. if startEnd is not provided, all rows will be displayed. if only one value is provided, there are two behaviors: - if positive, it shows the first N rows (e.g., ShowRange(5) shows first 5 rows) - if negative, it shows the last N rows (e.g., ShowRange(-5) shows last 5 rows) For two parameters [start, end], it shows rows from index start (inclusive) to index end (exclusive). If end is nil, it shows rows from index start to the end of the table. Example: dt.ShowRange() - shows all rows Example: dt.ShowRange(5) - shows the first 5 rows Example: dt.ShowRange(-5) - shows the last 5 rows Example: dt.ShowRange(2, 10) - shows rows with indices 2 to 9 (not including 10) Example: dt.ShowRange(2, nil) - shows rows from index 2 to the end of the table

func (*DataTable) ShowTypes added in v0.0.3 

func (dt *DataTable) ShowTypes()

ShowTypes displays the data types of each element in the DataTable. For more control over which rows to display, use ShowTypesRange.

func (*DataTable) ShowTypesRange added in v0.2.0 

func (dt *DataTable) ShowTypesRange(startEnd ...any)

ShowTypesRange displays the data types of each element in the DataTable within a specified range of rows. startEnd is an optional parameter that can be [start, end] to specify the range of rows to display. if startEnd is not provided, all rows will be displayed. if only one value is provided, there are two behaviors: - if positive, it shows the first N rows (e.g., ShowTypesRange(5) shows first 5 rows) - if negative, it shows the last N rows (e.g., ShowTypesRange(-5) shows last 5 rows) For two parameters [start, end], it shows rows from index start (inclusive) to index end (exclusive). If end is nil, it shows rows from index start to the end of the table. Example: dt.ShowTypesRange() - shows all rows Example: dt.ShowTypesRange(5) - shows the first 5 rows Example: dt.ShowTypesRange(-5) - shows the last 5 rows Example: dt.ShowTypesRange(2, 10) - shows rows with indices 2 to 9 (not including 10) Example: dt.ShowTypesRange(2, nil) - shows rows from index 2 to the end of the table

func (*DataTable) SimpleRandomSample added in v0.2.5 

func (dt *DataTable) SimpleRandomSample(sampleSize int) *DataTable

SimpleRandomSample returns a new DataTable containing a simple random sample of the specified size. If sampleSize is greater than the number of rows in the DataTable, it returns a copy of the original DataTable. If sampleSize is less than or equal to 0, it returns an empty DataTable.

func (*DataTable) Size added in v0.0.4 

func (dt *DataTable) Size() (numRows int, numCols int)

Size returns the number of rows and columns in the DataTable.

func (*DataTable) SortBy added in v0.2.5 

func (dt *DataTable) SortBy(configs ...DataTableSortConfig) *DataTable

SortBy sorts the DataTable based on multiple columns as specified in the configs. Supports sorting by column index (A, B, ...), column number (0, 1, ...), or column name. For multi-column sorting, the order of configs determines the priority (first config has highest priority).

func (*DataTable) Summary added in v0.2.0 

func (dt *DataTable) Summary()

Summary displays a comprehensive statistical summary of the DataTable directly to the console. It shows overall statistics for the entire table, including the number of rows and columns, and aggregate information about data types and values across the whole table. The output is formatted for easy reading with proper color coding.

func (*DataTable) SwapColsByIndex added in v0.2.2 

func (dt *DataTable) SwapColsByIndex(columnIndex1 string, columnIndex2 string) *DataTable

SwapColsByIndex swaps two columns by their letter indices.

func (*DataTable) SwapColsByName added in v0.2.2 

func (dt *DataTable) SwapColsByName(columnName1 string, columnName2 string) *DataTable

SwapColsByName swaps two columns by their names.

func (*DataTable) SwapColsByNumber added in v0.2.2 

func (dt *DataTable) SwapColsByNumber(columnNumber1 int, columnNumber2 int) *DataTable

SwapColsByNumber swaps two columns by their numerical indices.

func (*DataTable) SwapRowsByIndex added in v0.2.2 

func (dt *DataTable) SwapRowsByIndex(rowIndex1 int, rowIndex2 int) *DataTable

SwapRowsByIndex swaps two rows by their numerical indices.

func (*DataTable) SwapRowsByName added in v0.2.2 

func (dt *DataTable) SwapRowsByName(rowName1 string, rowName2 string) *DataTable

SwapRowsByName swaps two rows by their names.

func (*DataTable) To2DSlice added in v0.2.7 

func (dt *DataTable) To2DSlice() [][]any

To2DSlice converts the DataTable to a 2D slice of any. Each row in the DataTable becomes a slice in the outer slice, and each column's element at that row becomes an element in the inner slice. If a column is shorter than the maximum row count, nil values are used to fill.

func (*DataTable) ToCSV added in v0.0.3 

func (dt *DataTable) ToCSV(filePath string, setRowNamesToFirstCol bool, setColNamesToFirstRow bool, includeBOM bool) error

ToCSV converts the DataTable to CSV format and writes it to the provided file path. The function accepts two parameters: - filePath: the file path to write the CSV file to - setRowNamesToFirstCol: if true, the first column will be used as row names - setColNamesToFirstRow: if true, the first row will be used as column names

func (*DataTable) ToJSON added in v0.1.5 

func (dt *DataTable) ToJSON(filePath string, useColNames bool) error

ToJSON converts the DataTable to JSON format and writes it to the provided file path. The function accepts two parameters: - filePath: the file path to write the JSON file to. - useColName: if true, the column names will be used as keys in the JSON object, otherwise the column index(A, B, C...) will be used. Every row will be a JSON object with the column names as keys and the row values as values. The function returns an error if the file cannot be created or the JSON data cannot be written to the file.

func (*DataTable) ToJSON_Bytes added in v0.1.5 

func (dt *DataTable) ToJSON_Bytes(useColNames bool) []byte

ToJSON_Byte converts the DataTable to JSON format and returns it as a byte slice. The function accepts one parameter: - useColName: if true, the column names will be used as keys in the JSON object, otherwise the column index(A, B, C...) will be used. Every row will be a JSON object with the column names as keys and the row values as values. The function returns the JSON data as a byte slice.

func (*DataTable) ToJSON_String added in v0.2.8 

func (dt *DataTable) ToJSON_String(useColNames bool) string

ToJSON_String converts the DataTable to JSON format and returns it as a string. The function accepts one parameter: - useColName: if true, the column names will be used as keys in the JSON object, otherwise the column index(A, B, C...) will be used. Every row will be a JSON object with the column names as keys and the row values as values. The function returns the JSON data as a string.

func (*DataTable) ToMap added in v0.2.8 

func (dt *DataTable) ToMap(useNamesAsKeys ...bool) map[string][]any

ToMap is the alias for Data(). It returns a map[string][]any representation of the DataTable.

func (*DataTable) ToSQL added in v0.2.0 

func (dt *DataTable) ToSQL(db *gorm.DB, tableName string, options ...ToSQLOptions) error

func (*DataTable) Transpose added in v0.0.8 

func (dt *DataTable) Transpose() *DataTable

Transpose transposes the DataTable, converting rows into columns and vice versa.

func (*DataTable) UpdateCol added in v0.0.14 

func (dt *DataTable) UpdateCol(index string, dl *DataList) *DataTable

UpdateCol updates the column with the given index.

func (*DataTable) UpdateColByNumber added in v0.0.14 

func (dt *DataTable) UpdateColByNumber(index int, dl *DataList) *DataTable

UpdateColByNumber updates the column at the given index.

func (*DataTable) UpdateElement added in v0.0.2 

func (dt *DataTable) UpdateElement(rowIndex int, columnIndex string, value any) *DataTable

UpdateElement updates the element at the given row and column index.

func (*DataTable) UpdateRow added in v0.0.2 

func (dt *DataTable) UpdateRow(index int, dl *DataList) *DataTable

UpdateRow updates the row at the given index.

type DataTableSortConfig added in v0.2.5 

type DataTableSortConfig struct {
	ColumnIndex  string // The column index (A, B, C, ...) of the column to sort by, highest priority
	ColumnNumber int    // The column number (0, 1, 2, ...) of the column to sort by, lowest priority
	ColumnName   string // The column name of the column to sort by, second priority
	Descending   bool   // Whether to sort in descending order, default is ascending
}

type ErrPoppingMode added in v0.2.2 

type ErrPoppingMode int
const (
	// ErrPoppingModeFIFO retrieves the first error in the buffer.
	ErrPoppingModeFIFO ErrPoppingMode = iota
	// ErrPoppingModeLIFO retrieves the last error in the buffer.
	ErrPoppingModeLIFO
)

ErrPoppingMode defines the mode for popping errors.

type ErrorInfo added in v0.2.13 

type ErrorInfo struct {
	Level       LogLevel
	PackageName string
	FuncName    string
	Message     string
	Timestamp   time.Time
}

ErrorInfo represents a structured error with context information. It is the public-facing error type returned by error retrieval functions.

func GetAllErrors added in v0.2.13 

func GetAllErrors() []ErrorInfo

GetAllErrors returns a copy of all errors in the buffer without removing them. The returned slice is ordered from oldest to newest (FIFO order).

func GetErrorsByLevel added in v0.2.13 

func GetErrorsByLevel(level LogLevel) []ErrorInfo

GetErrorsByLevel returns all errors at the specified level without removing them.

func GetErrorsByPackage added in v0.2.13 

func GetErrorsByPackage(packageName string) []ErrorInfo

GetErrorsByPackage returns all errors from the specified package without removing them.

func PeekError added in v0.2.13 

func PeekError(mode ErrPoppingMode) *ErrorInfo

PeekError returns the error at the specified position without removing it. Returns nil if the buffer is empty or index is out of bounds. Mode determines whether to peek from the front (FIFO) or back (LIFO).

func PopAllErrors added in v0.2.13 

func PopAllErrors() []ErrorInfo

PopAllErrors retrieves and removes all errors from the buffer. The returned slice is ordered from oldest to newest (FIFO order).

func PopErrorInfo added in v0.2.13 

func PopErrorInfo(mode ErrPoppingMode) *ErrorInfo

PopErrorInfo retrieves and removes an error with full context information. Returns nil if the buffer is empty.

func (ErrorInfo) Error added in v0.2.13 

func (e ErrorInfo) Error() string

Error implements the error interface for ErrorInfo.

type F64orRat added in v0.0.9 

type F64orRat = utils.F64orRat

type IDataList 

type IDataList interface {
	AtomicDo(func(*DataList))
	GetCreationTimestamp() int64
	GetLastModifiedTimestamp() int64

	GetName() string
	SetName(string) *DataList
	Data() []any
	Append(values ...any) *DataList
	Concat(other IDataList) *DataList
	AppendDataList(other IDataList) *DataList
	Get(index int) any
	Clone() *DataList
	Count(value any) int
	Counter() map[any]int
	Update(index int, value any) *DataList
	InsertAt(index int, value any) *DataList
	FindFirst(any) any
	FindLast(any) any
	FindAll(any) []int
	Filter(func(any) bool) *DataList
	ReplaceFirst(any, any) *DataList
	ReplaceLast(any, any) *DataList
	ReplaceAll(any, any) *DataList
	ReplaceOutliers(float64, float64) *DataList
	Pop() any
	Drop(index int) *DataList
	DropAll(...any) *DataList
	DropIfContains(string) *DataList
	Clear() *DataList
	ClearStrings() *DataList
	ClearNumbers() *DataList
	ClearNaNs() *DataList
	ClearNils() *DataList
	ClearNilsAndNaNs() *DataList
	ClearOutliers(float64) *DataList
	ReplaceNaNsWith(any) *DataList
	ReplaceNilsWith(any) *DataList
	ReplaceNaNsAndNilsWith(any) *DataList
	Normalize() *DataList
	Standardize() *DataList
	FillNaNWithMean() *DataList
	MovingAverage(int) *DataList
	WeightedMovingAverage(int, any) *DataList
	ExponentialSmoothing(float64) *DataList
	DoubleExponentialSmoothing(float64, float64) *DataList
	MovingStdev(int) *DataList
	Len() int
	Sort(ascending ...bool) *DataList
	Map(mapFunc func(int, any) any) *DataList
	Rank(ascending ...bool) *DataList
	Reverse() *DataList
	Upper() *DataList
	Lower() *DataList
	Capitalize() *DataList // Statistics
	Sum() float64
	Max() float64
	Min() float64
	Mean() float64
	WeightedMean(weights any) float64
	GMean() float64
	Median() float64
	Mode() []float64
	MAD() float64
	Stdev() float64
	StdevP() float64
	Var() float64
	VarP() float64
	Range() float64
	Quartile(int) float64
	IQR() float64
	Percentile(float64) float64
	Difference() *DataList
	Summary()

	// Error handling (instance-level)
	Err() *ErrorInfo
	ClearErr() *DataList

	// comparison
	IsEqualTo(*DataList) bool
	IsTheSameAs(*DataList) bool
	Show()
	ShowRange(startEnd ...any)
	ShowTypes()
	ShowTypesRange(startEnd ...any)

	// conversion
	ParseNumbers() *DataList
	ParseStrings() *DataList
	ToF64Slice() []float64
	ToStringSlice() []string

	// Interpolation
	LinearInterpolation(float64) float64
	QuadraticInterpolation(float64) float64
	LagrangeInterpolation(float64) float64
	NearestNeighborInterpolation(float64) float64
	NewtonInterpolation(float64) float64
	HermiteInterpolation(float64, []float64) float64
	// contains filtered or unexported methods
}

IDataList defines the behavior expected from a DataList.

type IDataTable added in v0.0.1 

type IDataTable interface {
	AtomicDo(func(*DataTable))
	AppendCols(columns ...*DataList) *DataTable
	AppendRowsFromDataList(rowsData ...*DataList) *DataTable
	AppendRowsByColIndex(rowsData ...map[string]any) *DataTable
	AppendRowsByColName(rowsData ...map[string]any) *DataTable
	GetElement(rowIndex int, columnIndex string) any
	GetElementByNumberIndex(rowIndex int, columnIndex int) any
	GetCol(index string) *DataList
	GetColByNumber(index int) *DataList
	GetColByName(name string) *DataList
	GetRow(index int) *DataList
	GetRowByName(name string) *DataList
	UpdateElement(rowIndex int, columnIndex string, value any) *DataTable
	UpdateCol(index string, dl *DataList) *DataTable
	UpdateColByNumber(index int, dl *DataList) *DataTable
	UpdateRow(index int, dl *DataList) *DataTable
	SetColToRowNames(columnIndex string) *DataTable
	SetRowToColNames(rowIndex int) *DataTable
	ChangeColName(oldName, newName string) *DataTable
	GetColNameByNumber(index int) string
	GetColIndexByName(name string) string
	GetColIndexByNumber(number int) string
	GetColNumberByName(name string) int
	SetColNameByIndex(index string, name string) *DataTable
	SetColNameByNumber(numberIndex int, name string) *DataTable
	ColNamesToFirstRow() *DataTable
	DropColNames() *DataTable
	ColNames() []string
	Headers() []string
	SetColNames(colNames []string) *DataTable
	SetHeaders(headers []string) *DataTable
	FindRowsIfContains(value any) []int
	FindRowsIfContainsAll(values ...any) []int
	FindRowsIfAnyElementContainsSubstring(substring string) []int
	FindRowsIfAllElementsContainSubstring(substring string) []int
	FindColsIfContains(value any) []string
	FindColsIfContainsAll(values ...any) []string
	FindColsIfAnyElementContainsSubstring(substring string) []string
	FindColsIfAllElementsContainSubstring(substring string) []string
	DropColsByName(columnNames ...string) *DataTable
	DropColsByIndex(columnIndices ...string) *DataTable
	DropColsByNumber(columnIndices ...int) *DataTable
	DropColsContainString() *DataTable
	DropColsContainNumber() *DataTable
	DropColsContainNil() *DataTable
	DropColsContainNaN() *DataTable
	DropColsContain(value ...any) *DataTable
	DropColsContainExcelNA() *DataTable
	DropRowsByIndex(rowIndices ...int) *DataTable
	DropRowsByName(rowNames ...string) *DataTable
	DropRowsContainString() *DataTable
	DropRowsContainNumber() *DataTable
	DropRowsContainNil() *DataTable
	DropRowsContainNaN() *DataTable
	DropRowsContain(value ...any) *DataTable
	DropRowsContainExcelNA() *DataTable
	Data(useNamesAsKeys ...bool) map[string][]any
	// ToMap is the alias for Data().
	// It returns a map[string][]any representation of the DataTable.
	// Parameters:
	// - useNamesAsKeys: Whether to use column names as keys in the returned map
	// Returns:
	// - map[string][]any: DataTable represented as a map of columns
	ToMap(useNamesAsKeys ...bool) map[string][]any
	Show()
	ShowTypes()
	ShowRange(startEnd ...any)
	ShowTypesRange(startEnd ...any)
	// GetRowIndexByName returns the index of a row by its name.
	// Returns -1 and false if the row name does not exist.
	// Always check the boolean return value to distinguish between "name not found" and "last row",
	// since -1 typically represents the last element in Insyra's Get methods.
	GetRowIndexByName(name string) (int, bool)
	// GetRowNameByIndex returns the name of a row at the given index.
	// Returns empty string and false if no name is set for the row.
	GetRowNameByIndex(index int) (string, bool)
	SetRowNameByIndex(index int, name string) *DataTable
	ChangeRowName(oldName, newName string) *DataTable
	RowNamesToFirstCol() *DataTable
	DropRowNames() *DataTable
	RowNames() []string
	SetRowNames(rowNames []string) *DataTable
	GetCreationTimestamp() int64
	GetLastModifiedTimestamp() int64

	// name
	GetName() string
	SetName(name string) *DataTable

	// Statistics
	Size() (numRows int, numCols int)
	NumRows() int
	NumCols() int
	Count(value any) int
	Mean() any
	Summary()

	// Error handling (instance-level)
	Err() *ErrorInfo
	ClearErr() *DataTable

	// Operations
	Transpose() *DataTable
	Clone() *DataTable
	To2DSlice() [][]any
	SimpleRandomSample(sampleSize int) *DataTable
	Map(mapFunc func(rowIndex int, colIndex string, element any) any) *DataTable
	SortBy(configs ...DataTableSortConfig) *DataTable

	// Filters
	Filter(filterFunc func(rowIndex int, columnIndex string, value any) bool) *DataTable
	FilterByCustomElement(f func(value any) bool) *DataTable
	FilterRows(filterFunc func(colIndex, colName string, x any) bool) *DataTable
	FilterCols(filterFunc func(rowIndex int, rowName string, x any) bool) *DataTable
	FilterColsByColIndexGreaterThan(threshold string) *DataTable
	FilterColsByColIndexGreaterThanOrEqualTo(threshold string) *DataTable
	FilterColsByColIndexLessThan(threshold string) *DataTable
	FilterColsByColIndexLessThanOrEqualTo(threshold string) *DataTable
	FilterColsByColIndexEqualTo(index string) *DataTable
	FilterColsByColNameEqualTo(name string) *DataTable
	FilterColsByColNameContains(substring string) *DataTable
	FilterRowsByRowNameEqualTo(name string) *DataTable
	FilterRowsByRowNameContains(substring string) *DataTable
	FilterRowsByRowIndexGreaterThan(threshold int) *DataTable
	FilterRowsByRowIndexGreaterThanOrEqualTo(threshold int) *DataTable
	FilterRowsByRowIndexLessThan(threshold int) *DataTable
	FilterRowsByRowIndexLessThanOrEqualTo(threshold int) *DataTable
	FilterRowsByRowIndexEqualTo(index int) *DataTable

	// Swap
	SwapColsByName(columnName1 string, columnName2 string) *DataTable
	SwapColsByIndex(columnIndex1 string, columnIndex2 string) *DataTable
	SwapColsByNumber(columnNumber1 int, columnNumber2 int) *DataTable
	SwapRowsByIndex(rowIndex1 int, rowIndex2 int) *DataTable
	SwapRowsByName(rowName1 string, rowName2 string) *DataTable
	// CSV
	ToCSV(filePath string, setRowNamesToFirstCol bool, setColNamesToFirstRow bool, includeBOM bool) error
	// JSON
	// ToJSON saves the DataTable as a JSON file.
	// Parameters:
	// - filePath: Output JSON file path
	// - useColNames: Whether to use column names as keys in JSON objects
	// Returns:
	// - error: Error information, returns nil if successful
	ToJSON(filePath string, useColNames bool) error
	// ToJSON_Bytes converts the DataTable to JSON format and returns it as a byte slice.
	// Parameters:
	// - useColNames: Whether to use column names as keys in JSON objects
	// Returns:
	// - []byte: JSON data as byte slice
	ToJSON_Bytes(useColNames bool) []byte
	// ToJSON_String converts the DataTable to JSON format and returns it as a string.
	// Parameters:
	// - useColNames: Whether to use column names as keys in JSON objects
	// Returns:
	// - string: JSON data as a string
	ToJSON_String(useColNames bool) string

	ToSQL(db *gorm.DB, tableName string, options ...ToSQLOptions) error

	Merge(other IDataTable, direction MergeDirection, mode MergeMode, on ...string) (*DataTable, error)

	AddColUsingCCL(newColName, ccl string) *DataTable

	// Replace
	Replace(oldValue, newValue any) *DataTable
	ReplaceNaNsWith(newValue any) *DataTable
	ReplaceNilsWith(newValue any) *DataTable
	ReplaceNaNsAndNilsWith(newValue any) *DataTable
	ReplaceInRow(rowIndex int, oldValue, newValue any, mode ...int) *DataTable
	ReplaceNaNsInRow(rowIndex int, newValue any, mode ...int) *DataTable
	ReplaceNilsInRow(rowIndex int, newValue any, mode ...int) *DataTable
	ReplaceNaNsAndNilsInRow(rowIndex int, newValue any, mode ...int) *DataTable
	ReplaceInCol(colIndex string, oldValue, newValue any, mode ...int) *DataTable
	ReplaceNaNsInCol(colIndex string, newValue any, mode ...int) *DataTable
	ReplaceNilsInCol(colIndex string, newValue any, mode ...int) *DataTable
	ReplaceNaNsAndNilsInCol(colIndex string, newValue any, mode ...int) *DataTable
	// contains filtered or unexported methods
}

IDataTable defines the behavior expected from a DataTable.

func ConvertLongDataToWide added in v0.0.8 

func ConvertLongDataToWide(data, factor IDataList, independents []IDataList, aggFunc func([]float64) float64) IDataTable

ConvertLongDataToWide converts long data to wide data. data: 觀測值(依變數) factor: 因子 independents: 自變數 aggFunc: 聚合函數 Return DataTable.

type LogLevel 

type LogLevel int
const (
	// LogLevelDebug is the log level for debug messages.
	LogLevelDebug LogLevel = iota
	// LogLevelInfo is the log level for info messages.
	LogLevelInfo
	// LogLevelWarning is the log level for warning messages.
	LogLevelWarning
	// LogLevelFatal is the log level for fatal messages.
	LogLevelFatal
)

func PopError added in v0.2.2 

func PopError(mode ErrPoppingMode) (LogLevel, string)

PopError retrieves and removes the first error from the buffer. If the buffer is empty, it returns an empty string and LogLevelInfo.

func PopErrorByFuncName added in v0.2.2 

func PopErrorByFuncName(packageName, funcName string, mode ErrPoppingMode) (LogLevel, string)

func PopErrorByPackageName added in v0.2.2 

func PopErrorByPackageName(packageName string, mode ErrPoppingMode) (LogLevel, string)

func (LogLevel) String added in v0.2.13 

func (l LogLevel) String() string

String returns a string representation of the LogLevel.

type MergeDirection added in v0.2.11 

type MergeDirection int
const (
	MergeDirectionHorizontal MergeDirection = iota
	MergeDirectionVertical
)

type MergeMode added in v0.2.11 

type MergeMode int
const (
	MergeModeInner MergeMode = iota
	MergeModeOuter
	MergeModeLeft
	MergeModeRight
)

type ReadSQLOptions added in v0.2.0 

type ReadSQLOptions struct {
	RowNameColumn string // Specifies which column to use as row names, default is "row_name"
	Query         string // Custom SQL query, if provided, other options will be ignored
	Limit         int    // Limit the number of rows to read
	Offset        int    // Starting position for reading rows
	WhereClause   string // WHERE clause
	OrderBy       string // ORDER BY clause
}

type SQLActionIfTableExists added in v0.2.0 

type SQLActionIfTableExists int
const (
	SQLActionIfTableExistsFail SQLActionIfTableExists = iota
	SQLActionIfTableExistsReplace
	SQLActionIfTableExistsAppend
)

type ToSQLOptions added in v0.2.0 

type ToSQLOptions struct {
	IfExists    SQLActionIfTableExists // "fail", "replace", "append"
	RowNames    bool
	ColumnTypes map[string]string // 自訂型別
}

Source Files

View all Source files

Directories

Path Synopsis
`allpkgs` package imports all Insyra packages.
 `allpkgs` package imports all Insyra packages.
cli
commands
env
repl
style
`csvxl` package provides functions for converting between CSV and Excel formats.
 `csvxl` package provides functions for converting between CSV and Excel formats.
file: insyra/datafetch/yfinance_errors.go
 file: insyra/datafetch/yfinance_errors.go
internal/limiter
Package engine exposes reusable core utilities for external projects.
 Package engine exposes reusable core utilities for external projects.
algorithms
atomic
biindex
ccl
dsl
ring
`gplot` package provides functions for data visualization using gonum/plot.
 `gplot` package provides functions for data visualization using gonum/plot.
internal
algorithms
ccl
core
csv
utils
`isr` package is the syntactic sugar of insyra.
 `isr` package is the syntactic sugar of insyra.
`lp` package provides linear programming functionalities using GLPK.
 `lp` package provides linear programming functionalities using GLPK.
`lpgen` package provides functions for generating linear programming models.
 `lpgen` package provides functions for generating linear programming models.
`mkt` package provides marketing-related data analysis functions.
 `mkt` package provides marketing-related data analysis functions.
`parallel` package provides functions for parallel processing.
 `parallel` package provides functions for parallel processing.
`plot` package provides functions for creating and manipulating plots.
 `plot` package provides functions for creating and manipulating plots.
internal
py
`py` package provides functions for working with Python.
 `py` package provides functions for working with Python.
internal/ipc
`stats` package provides functions for statistical analysis.
 `stats` package provides functions for statistical analysis.
tools
gendocs command

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.