{"id":12030,"date":"2021-05-28T17:06:18","date_gmt":"2021-05-28T17:06:18","guid":{"rendered":"https:\/\/machinelearningplus.com\/?p=4882"},"modified":"2022-05-16T09:30:19","modified_gmt":"2022-05-16T09:30:19","slug":"vaex","status":"publish","type":"post","link":"https:\/\/machinelearningplus.com\/python\/vaex\/","title":{"rendered":"Vaex – Faster Pandas Alternate in Python"},"content":{"rendered":"

Vaex Python is an alternative to the Pandas library that take less time to do computations on huge data using Out of Core Dataframe. It has fast, interactive visualization capabilities as well.<\/em><\/p>\r\n

Pandas is the most widely used python library for dealing with dataframes and processing. The popularity is due to the convenient, easy to understand API it offers along with wide variety of tools. But then, pandas has it shortcomings and a alternative is Vaex. Let’s find out exactly why!<\/p>\r\n

\"\"<\/p>\r\n

1. Why do we need Vaex ?<\/h2>\r\n

Pandas is a python library used extensively for reading csv files and processsing dataframes. While pandas works smoothly while dealing with smaller data, it becomes very slow and inefficient<\/strong> when there are huge datasets<\/strong>.<\/p>\r\n

Nowadays, it has become very common to encounter datasets that are larger than the available RAM on your system. In cases like these, pandas can’t help you. Also, the complex groupby operations are very slow in pandas. It also does not support memory mapped datasets.<\/p>\r\n

What is the solution we need for this ?<\/p>\r\n

We need a solution that can resolve all the above problems while still providing a convenient API. That solution is nothing but Vaex !<\/p>\r\n

In the upcoming sections, I shall tell you what exactly Vaex is and why is it an alternative to pandas.<\/p>\r\n

Related Post: How to speed up pandas by changing one line of code using Modin?<\/a><\/p>\r\n

2. What is Vaex ?<\/h2>\r\n

Vaex is a python library that is closely similar to Pandas. Vaex is a library especially for lazy Out-of-Core DataFrames, helps to visualize and explore big tabular datasets.<\/strong> It is a high performance library and can solve many of the shortcomings of pandas. As the API is similar to pandas, users do not face difficulty in shifting. It’s also integrated with Jupyter which makes it easy.<\/p>\r\n

Vaex is capable to calculate statistics such as mean, standard deviation etc, on an N-dimensional grid up to a billion (109109) objects\/rows per second.<\/strong> It can also help in the Visualization using histograms, density plots and 3d volume rendering, allowing interactive exploration of big data.<\/p>\r\n

Vaex achieves this high performance through the combination of memory mapping, a zero memory copy policy, and lazy computations, etc. Don’t worry if you these terms go over your head. I shall explain each of them in detail with examples.<\/p>\r\n

First, install and import the python library as shown below.<\/p>\r\n

# !pip install vaex\r\n
import vaex<\/code>\r\n<\/code><\/pre>\r\n
3. Vaex uses Memory mapping for large datasets<\/h2>\r\n
As we discussed previously, vaex is very useful in case of huge tabular datasets. Let’s say we have a dataset that is larger than the RAM available. How can you load this using vaex ?<\/p>\r\n
Vaex uses Memory mapping to solve this. All the dataset files read into vaex are memory mapped.<\/p>\r\n
When you open a memory mapped file with Vaex, you don’t actually read the data. Vaex will swiftly reads the file metadata (like the location of the data on disk, number of rows, number of columns, column names and types), the file description. So, you can open these files quickly, irrespective of how much RAM you have. But remember that format of memory mappable files are Apache Arrow , HDF5, etc.<\/p>\r\n
Let’s see an example. You can download the dataset I’m using from here<\/a><\/p>\r\n
# Reading data from local disk \r\ndf=vaex.open('yellow_tripdata_2020-01.hdf5')\r\n<\/code><\/pre>\r\n
But many times, the data available is in the form of CSV files. In these cases, you will have to convert the CSV data into HDF5 format.<\/p>\r\n
How to convert a csv file to hdf5 using vaex?<\/strong><\/p>\r\n
We have a big csv file here. You can use the vaex.from_csv()<\/code> function to load in csv files. There is a parameter convert<\/code> to decide if you want to convert it into HDF5 or not. In this case, we go for convert=True<\/code>.<\/p>\r\n
Vaex will read the CSV in chunks, and convert each chunk to a temporary HDF5 file which is further concatenated into a single HDF5 file.You can decide the size of the individual chunks using chunk_size<\/code> argument.<\/p>\r\n
# Converting csv into HDF5 and reading dataframe\r\n%time df = vaex.from_csv('yellow_tripdata_2020-01.csv', convert=True)\r\ndf\r\n<\/code><\/pre>\r\n
Wall time: 1.43 s<\/code><\/p>\r\n

\r\n<\/code><\/p>\r\n
\"Car
<\/a><\/code>You can see that it took merely 1.43 seconds !  Lets see how much time it would have taken using normal pandas.<\/p>\r\n
import pandas as pd\r\n%time pandas_df = pd.read_csv('yellow_tripdata_2020-01.csv')\r\n<\/code>\r\n\r\nWall time: 2min 34s\r\n<\/code><\/pre>\r\n
 <\/div>\r\n
It took 2min 34 seconds, which is so slow compared to using vaex. I hope you understood how much time memory mapping can save through this comparison.<\/p>\r\n
4. Vaex is lazy : Saves memory<\/h2>\r\n
We know that Vaex is very similar to the pandas API. But, there is a fundamental distinction between vaex and pandas.<\/p>\r\n
Vaex is lazy.<\/p>\r\n
That means, vaex does not actually perform the operation or read through whole data unless necessary (unlike pandas). For example, say you call an expression like: df['passenger_count'].mean<\/code>, the actual computations does not happen. It just notes down what computations it must do. A vaex expression object is created instead, and when printed out it shows some preview values. This significantly saves memory space.<\/p>\r\n
df['passenger_count'].mean\r\n<\/code><\/pre>\r\n
Let’s have a look at another lazy computation example.<\/p>\r\n
import numpy as np\r\nnp.sqrt(df.passenger_count**2 + df.trip_distance**2)\r\n<\/code><\/pre>\r\n
Expression = sqrt(((passenger_count ** 2) + (trip_distance ** 2)))
\r\nLength: 6,405,008 dtype: float64 (expression)\r\n---------------------------------------------\r\n      0  1.56205\r\n      1  1.56205\r\n      2  1.16619\r\n      3  1.28062\r\n      4        1\r\n      ...       \r\n6405003      nan\r\n6405004      nan\r\n6405005      nan\r\n6405006      nan\r\n6405007      nan\r\n<\/code><\/pre>\r\n
With the expression system, vaex performs calculations only when needed. Also, the data does not need to be local, expressions can be sent over a wire, and statistics can be computed remotely, something that the vaex-server package provides.<\/p>\r\n
Let’s move ahead to other interesting features with vaex. You’ll be able to observe the “lazy computation” is a main foundation behind many of them.<\/p>\r\n
5. Virtual Columns<\/h2>\r\n
When you write expressions to create a new column in vaex dataframe, a virtual colum is created.<\/p>\r\n
But what is a virtual column?<\/p>\r\n
A virtual column behaves just like a regular column but occupies no memory.<\/strong> Why is this so ?<\/p>\r\n
This is because Vaex only remembers the expression the defines them. It does not calculate the values up front like pandas.This saves both memory and time .These columns are lazily evaluated only when it is necessary, keeping memory usage low.<\/p>\r\n
Let’s look at an example.<\/p>\r\n
Consider the dataframe df<\/code> we loaded in previous section. we’ll use the same here. Let’s write an expression to create a new column new_trip_distance<\/code>as per the below expression. This column will now be a virtual column and no memory alotted. Let’s record the time taken too.<\/p>\r\n
%time df['new_trip_distance'] = df['trip_distance'] + 10\r\n<\/code><\/pre>\r\n
Wall time: 998 \u00b5s\r\n<\/code><\/pre>\r\n
The task was completed in microseconds because there was no need to allot memory. Lets see how much time we saved by performing the same task on the pandas dataframe. Check below code and time.<\/p>\r\n
%time pandas_df['new_trip_distance'] = pandas_df['trip_distance'] + 10<\/code>\r\n\r\n\r\nWall time: 1.34 s\r\n<\/code><\/pre>\r\n
It took almost 1500x more time for this!<\/p>\r\n
Also, this virtual column new_trip_distnace<\/code> is lazily evaluated on the fly when required.<\/p>\r\n
df<\/code><\/p>\r\n
\"Car
<\/a><\/code>I hope you understood how virtual columns work, let’s move ahead to other operations and features<\/p>\r\n
6. Data cleansing with Vaex<\/h2>\r\n
Data cleaning and filtering are the crucial steps that often take up a lot of time in python. For example, let’s take the same dataframe we used in previous sections. Say you wish to filter out the records whose passenger_count<\/code> is greater than 10. Let’s try it using the normal pandas and see how much time it takes.<\/p>\r\n
%time df_filtered=pandas_df[pandas_df['passenger_count']>10]\r\n<\/code><\/pre>\r\n
Wall time: 13.6 s\r\n<\/code><\/pre>\r\n
You can see that it’s slow. Let’s see perform the same task on the vaex dataframe.<\/p>\r\n
%time df_filtered=df[df['passenger_count']>10]\r\n<\/code><\/pre>\r\n
Wall time: 611 ms\r\nParser   : 106 ms\r\n<\/code><\/pre>\r\n
Vaex reduced the time taken from 13.6 seconds to micro seconds!<\/p>\r\n
Hoe did vaex manage to do that ?<\/p>\r\n
It is because of the zero memory copy policy<\/strong> followed by vaex. This means that filtering a DataFrame costs very little memory and does not copy the data. df_filtered<\/code> has a \u2018view\u2019 on the original data. Even when you filter a 1TB file, just a fraction of the file will be read. This means that when you have large no of missing values, you can drop them or fill them at almost no cost.<\/p>\r\n
%time df_fillna=df.fillna(value=0, column_names=['passenger_count'])\r\ndf_fillna\r\n<\/code><\/pre>\r\n
Wall time: 483 ms<\/code><\/p>\r\n

\r\n<\/code><\/p>\r\n
\"Vaex<\/a>
<\/code>Vaex did the painful task very quickly for us.<\/p>\r\n
7. Statistics performance : Vaex vs Pandas<\/h2>\r\n
Vaex is very popular for the high performance it offers when it comes to statistics. While dealing with big tabular datsets ,you will need a alternative to pandas’s groupby<\/code>. You need a solution that is computationally much faster.So, Vaex alllows you to perform statistics on a regular N-dimensional grid<\/strong>, which is blazing fast. It has been proven that Vaex can calculate the mean of about a billion row data in just a second !<\/p>\r\n
Below is an example of efficient calculation of statistics on N-dimensional grids<\/p>\r\n
# Every statistic method accepts a binby argument to compute statistics on regular Nd array\r\ndf.mean(df.passenger_count, binby=df.DOLocationID, shape=20)\r\n<\/code><\/pre>\r\n
array([1.53489408, 1.49914832, 1.49319968, 1.54545849, 1.49560378,\r\n       1.52010031, 1.50486626, 1.52510748, 1.51555149, 1.55267282,\r\n       1.50574786, 1.5412169 , 1.50043236, 1.48509443, 1.52030571,\r\n       1.53979913, 1.48159731, 1.51295217, 1.51658428, 1.52362767])\r\n<\/code><\/pre>\r\n
Now let’s compare some statistic computations of pandas and vaex.<\/p>\r\n
Below, let’s try and calculate the mean of any column using both pandas and vaex.<\/p>\r\n
%time df.mean(df.fare_amount)\r\n<\/code><\/pre>\r\n
Wall time: 769 ms\r\n\r\n\r\narray(12.69410812)\r\n<\/code><\/pre>\r\n


%time pandas_df['fare_amount'].mean()\r\n<\/code><\/pre>\r\n
Wall time: 1.64 s\r\n\r\n12.69410811978051\r\n<\/code><\/pre>\r\n
Vaex was 3X times faster in above case<\/p>\r\n
8. Selections<\/h2>\r\n
In the previous section, we saw how strong vaex was in statistics. Let’s explore another interesting feature offered by vaex : Selections .<\/p>\r\n
A Selection is used to define a subset of the data. This helps in two ways. Firstly, it helps to filter te data from the dataframe quick. Apart from this , selections enable you to calculate the statistics for multiple subsets in a single pass over the data. We can do multiple steps in a single line, that too amazingly fast! This application is very useful especially while dealing with DataFrames that don\u2019t fit into memory (Out-of-core).<\/p>\r\n
Let’s understand how to use selections with an example. Say for the previous dataframe of New york taxi data, we need to create subsets based on no of passengers and find the mean fare amount for each subset.Using selection, it can be done in a si gle line as shown below.<\/p>\r\n
df.mean(df.fare_amount,selection=[df.passenger_count<2,df.passenger_count>2])\r\n<\/code><\/pre>\r\n
array([12.38094964, 12.6061761 ])\r\n<\/code><\/pre>\r\n
You might have also noticed that it was very quick! Because, vaex does not copy the data like pandas. What does it do then ?Vaex internally keeps track which rows are selected.<\/p>\r\n
Apart from this, there is another main use-case of the bin computation and the selections feature : they make visualization faster and easier! Let’s learn about them in the next section.<\/p>\r\n
9. Fast Visualizations with Vaex<\/h2>\r\n
Visualizations are a crucial part to understanding the data we have. It gives a clear result to picture the trends and derive insights. But when you have huge data frame of million rows, making standard scatter plots takes a really long time. Not only that, but the visualizations are illegible and not clear. What is the solution here ?<\/p>\r\n
Again, Vaex saves the day!<\/p>\r\n
With the help of group aggregations, selections and bins, vaex can compute these visualizations pretty quickly. Most of the visualizations are done in 1 or 2 dimensions. Also and Vaex nicely wraps Matplotlib so that python users are convenient. We shall see some examples of fast visualizations in this section.<\/p>\r\n
1D PLOTS<\/h3>\r\n
Consider the dataframe used previously. Let’s say we need to visualize the values taken by fare_amount<\/code>. You can easily visualize through a 1D plot by making use of vaex’s plot1d()<\/code> function. There is a parameter limits<\/code> that will show a histogram showing 99.7% of the data as shown below.<\/p>\r\n
%time df.plot1d(df.fare_amount,limits='99.7%')\r\n<\/code><\/pre>\r\n
Wall time: 404 ms\r\n\r\n\r\n\r\n\r\n\r\n[]\r\n<\/code><\/pre>\r\n
\"\"<\/p>\r\n
2D PLOTS<\/h3>\r\n
We can also visualize the data in a 2D histogram or heatmap. The DataFrame.plot()<\/code> function is used for this.
Now, let’s try and to plot a 2D plot using the same dataframe on NYC taxi data. Check below code.<\/p>\r\n
df.plot(df.total_amount , df.trip_distance, limits=[-20,20])\r\n<\/code><\/pre>\r\n
\"\"<\/p>\r\n
Let us look at a few more examples. For this, I will be using the example dataframe inbuilt in vaex. You can simply load it bu calling vaex.example()<\/code>. Below is the view to this dataframe.<\/p>\r\n
df_example = vaex.example()\r\ndf_example

\"Vaex<\/a><\/code><\/pre>\r\n
Let’s create a 2D plot using this df_example<\/code>. An amazing feature vaex offers is the what<\/code> parameter of the plot()<\/code> function. You can define the mathematical relation which has to be plotted(shape equals length of what argument). Below is an example of 2D plotting<\/p>\r\n
df_example.plot(df_example.x, df_example.y, what=vaex.stat.mean(df_example.E)**2, limits='99.7%')\r\n<\/code><\/pre>\r\n
\"\"<\/p>\r\n
Selections for plotting<\/strong><\/p>\r\n
Previously, we saw that vaex uses selections to speed up filtering. These also help in fast visualizations. Instead of filtering and having 4 different columns like in pandas, you can have 4 (named) selections in your DataFrame. Now, you can calculate statistics in just one single pass over the data. This is significantly faster especially in the cases when your dataset is larger than your RAM. Let’s see an example below. I have plotted using three selections.<\/p>\r\n
df_example.plot(df_example.x, df_example.y, what=np.log(vaex.stat.count()+1), limits='99.7%',\r\n        selection=[None, df_example.x < df_example.y, df_example.x < -10]);\r\n<\/code><\/pre>\r\n
\"\"<\/p>\r\n
You can see that, by default the graphs are faded on top of each other type. If you want it as separate column , then you can pass the option through the visual<\/code> parameter. This Will plot each selection as a column. See below example<\/p>\r\n
import numpy as np\r\ndf_example.plot(df_example.x, df_example.y, what=np.log(vaex.stat.count()+1), limits='99.7%',\r\n        selection=[None, df_example.x < df_example.y, df_example.x < -10],visual=dict(column='selection'))\r\n<\/code><\/pre>\r\n
\"\"<\/p>\r\n
 <\/code><\/pre>\r\n\r\n\r\n
<\/p>\r\n\r\n","protected":false},"excerpt":{"rendered":"
Vaex Python is an alternative to the Pandas library that take less time to do computations on huge data using Out of Core Dataframe. It has fast, interactive visualization capabilities as well. Pandas is the most widely used python library for dealing with dataframes and processing. The popularity is due to the convenient, easy to […]<\/p>\n","protected":false},"author":14,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"site-sidebar-layout":"default","site-content-layout":"default","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[21],"tags":[58,22,1949],"class_list":["post-12030","post","type-post","status-publish","format-standard","hentry","category-python","tag-multiprocessing","tag-python","tag-vaex"],"acf":[],"yoast_head":"\nVaex - Faster Pandas Alternate in Python - machinelearningplus<\/title>\n<meta name=\"description\" content=\"Vaex Python is an alternative to the Pandas library that take less time to do computations on huge data using Out of Core Dataframe. It has fast, interactive visualization capabilities as well.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/localhost:8080\/python\/vaex\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Vaex - Faster Pandas Alternate in Python - machinelearningplus\" \/>\n<meta property=\"og:description\" content=\"Vaex Python is an alternative to the Pandas library that take less time to do computations on huge data using Out of Core Dataframe. It has fast, interactive visualization capabilities as well.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/localhost:8080\/python\/vaex\/\" \/>\n<meta property=\"og:site_name\" content=\"machinelearningplus\" \/>\n<meta property=\"article:published_time\" content=\"2021-05-28T17:06:18+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-05-16T09:30:19+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/localhost:8080\/wp-content\/uploads\/2020\/11\/Vaes-cover-picture.jpg\" \/>\n<meta name=\"author\" content=\"Shrivarsheni\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Shrivarsheni\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"12 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"TechArticle\",\"@id\":\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/\"},\"author\":{\"name\":\"Shrivarsheni\",\"@id\":\"https:\\\/\\\/machinelearningplus.com\\\/#\\\/schema\\\/person\\\/31d782fda106181b2c88151a1d50a90d\"},\"headline\":\"Vaex – Faster Pandas Alternate in Python\",\"datePublished\":\"2021-05-28T17:06:18+00:00\",\"dateModified\":\"2022-05-16T09:30:19+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/\"},\"wordCount\":2009,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/machinelearningplus.com\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/machinelearningplus.com\\\/wp-content\\\/uploads\\\/2020\\\/11\\\/Vaes-cover-picture.jpg\",\"keywords\":[\"Multiprocessing\",\"Python\",\"Vaex\"],\"articleSection\":[\"Python\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/\",\"url\":\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/\",\"name\":\"Vaex - Faster Pandas Alternate in Python - machinelearningplus\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/machinelearningplus.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/machinelearningplus.com\\\/wp-content\\\/uploads\\\/2020\\\/11\\\/Vaes-cover-picture.jpg\",\"datePublished\":\"2021-05-28T17:06:18+00:00\",\"dateModified\":\"2022-05-16T09:30:19+00:00\",\"description\":\"Vaex Python is an alternative to the Pandas library that take less time to do computations on huge data using Out of Core Dataframe. It has fast, interactive visualization capabilities as well.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/localhost:8080\\\/python\\\/vaex\\\/#primaryimage\",\"url\":\"https:\\\/\\\/machinelearningplus.com\\\/wp-content\\\/uploads\\\/2020\\\/11\\\/Vaes-cover-picture.jpg\",\"contentUrl\":\"https:\\\/\\\/machinelearningplus.com\\\/wp-content\\\/uploads\\\/2020\\\/11\\\/Vaes-cover-picture.jpg\",\"width\":1280,\"height\":719},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/machinelearningplus.com\\\/#website\",\"url\":\"https:\\\/\\\/machinelearningplus.com\\\/\",\"name\":\"machinelearningplus\",\"description\":\"Learn Data Science (AI \\\/ ML) Online\",\"publisher\":{\"@id\":\"https:\\\/\\\/machinelearningplus.com\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/machinelearningplus.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/machinelearningplus.com\\\/#organization\",\"name\":\"machinelearningplus\",\"url\":\"https:\\\/\\\/machinelearningplus.com\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/machinelearningplus.com\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/machinelearningplus.com\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/MachineLearningplus-logo.svg\",\"contentUrl\":\"https:\\\/\\\/machinelearningplus.com\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/MachineLearningplus-logo.svg\",\"width\":348,\"height\":36,\"caption\":\"machinelearningplus\"},\"image\":{\"@id\":\"https:\\\/\\\/machinelearningplus.com\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/machinelearningplus.com\\\/#\\\/schema\\\/person\\\/31d782fda106181b2c88151a1d50a90d\",\"name\":\"Shrivarsheni\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/machinelearningplus.com\\\/wp-content\\\/litespeed\\\/avatar\\\/0d1ccfbd64a15f0b94a69cc383b21358.jpg?ver=1783629629\",\"url\":\"https:\\\/\\\/machinelearningplus.com\\\/wp-content\\\/litespeed\\\/avatar\\\/0d1ccfbd64a15f0b94a69cc383b21358.jpg?ver=1783629629\",\"contentUrl\":\"https:\\\/\\\/machinelearningplus.com\\\/wp-content\\\/litespeed\\\/avatar\\\/0d1ccfbd64a15f0b94a69cc383b21358.jpg?ver=1783629629\",\"caption\":\"Shrivarsheni\"},\"url\":\"https:\\\/\\\/machinelearningplus.com\\\/author\\\/shrivarsheni\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Vaex - Faster Pandas Alternate in Python - machinelearningplus","description":"Vaex Python is an alternative to the Pandas library that take less time to do computations on huge data using Out of Core Dataframe. It has fast, interactive visualization capabilities as well.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/localhost:8080\/python\/vaex\/","og_locale":"en_US","og_type":"article","og_title":"Vaex - Faster Pandas Alternate in Python - machinelearningplus","og_description":"Vaex Python is an alternative to the Pandas library that take less time to do computations on huge data using Out of Core Dataframe. It has fast, interactive visualization capabilities as well.","og_url":"https:\/\/localhost:8080\/python\/vaex\/","og_site_name":"machinelearningplus","article_published_time":"2021-05-28T17:06:18+00:00","article_modified_time":"2022-05-16T09:30:19+00:00","og_image":[{"url":"https:\/\/localhost:8080\/wp-content\/uploads\/2020\/11\/Vaes-cover-picture.jpg","type":"","width":"","height":""}],"author":"Shrivarsheni","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Shrivarsheni","Est. reading time":"12 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"TechArticle","@id":"https:\/\/localhost:8080\/python\/vaex\/#article","isPartOf":{"@id":"https:\/\/localhost:8080\/python\/vaex\/"},"author":{"name":"Shrivarsheni","@id":"https:\/\/machinelearningplus.com\/#\/schema\/person\/31d782fda106181b2c88151a1d50a90d"},"headline":"Vaex – Faster Pandas Alternate in Python","datePublished":"2021-05-28T17:06:18+00:00","dateModified":"2022-05-16T09:30:19+00:00","mainEntityOfPage":{"@id":"https:\/\/localhost:8080\/python\/vaex\/"},"wordCount":2009,"commentCount":0,"publisher":{"@id":"https:\/\/machinelearningplus.com\/#organization"},"image":{"@id":"https:\/\/localhost:8080\/python\/vaex\/#primaryimage"},"thumbnailUrl":"https:\/\/machinelearningplus.com\/wp-content\/uploads\/2020\/11\/Vaes-cover-picture.jpg","keywords":["Multiprocessing","Python","Vaex"],"articleSection":["Python"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/localhost:8080\/python\/vaex\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/localhost:8080\/python\/vaex\/","url":"https:\/\/localhost:8080\/python\/vaex\/","name":"Vaex - Faster Pandas Alternate in Python - machinelearningplus","isPartOf":{"@id":"https:\/\/machinelearningplus.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/localhost:8080\/python\/vaex\/#primaryimage"},"image":{"@id":"https:\/\/localhost:8080\/python\/vaex\/#primaryimage"},"thumbnailUrl":"https:\/\/machinelearningplus.com\/wp-content\/uploads\/2020\/11\/Vaes-cover-picture.jpg","datePublished":"2021-05-28T17:06:18+00:00","dateModified":"2022-05-16T09:30:19+00:00","description":"Vaex Python is an alternative to the Pandas library that take less time to do computations on huge data using Out of Core Dataframe. It has fast, interactive visualization capabilities as well.","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/localhost:8080\/python\/vaex\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/localhost:8080\/python\/vaex\/#primaryimage","url":"https:\/\/machinelearningplus.com\/wp-content\/uploads\/2020\/11\/Vaes-cover-picture.jpg","contentUrl":"https:\/\/machinelearningplus.com\/wp-content\/uploads\/2020\/11\/Vaes-cover-picture.jpg","width":1280,"height":719},{"@type":"WebSite","@id":"https:\/\/machinelearningplus.com\/#website","url":"https:\/\/machinelearningplus.com\/","name":"machinelearningplus","description":"Learn Data Science (AI \/ ML) Online","publisher":{"@id":"https:\/\/machinelearningplus.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/machinelearningplus.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/machinelearningplus.com\/#organization","name":"machinelearningplus","url":"https:\/\/machinelearningplus.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/machinelearningplus.com\/#\/schema\/logo\/image\/","url":"https:\/\/machinelearningplus.com\/wp-content\/uploads\/2022\/05\/MachineLearningplus-logo.svg","contentUrl":"https:\/\/machinelearningplus.com\/wp-content\/uploads\/2022\/05\/MachineLearningplus-logo.svg","width":348,"height":36,"caption":"machinelearningplus"},"image":{"@id":"https:\/\/machinelearningplus.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/machinelearningplus.com\/#\/schema\/person\/31d782fda106181b2c88151a1d50a90d","name":"Shrivarsheni","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/machinelearningplus.com\/wp-content\/litespeed\/avatar\/0d1ccfbd64a15f0b94a69cc383b21358.jpg?ver=1783629629","url":"https:\/\/machinelearningplus.com\/wp-content\/litespeed\/avatar\/0d1ccfbd64a15f0b94a69cc383b21358.jpg?ver=1783629629","contentUrl":"https:\/\/machinelearningplus.com\/wp-content\/litespeed\/avatar\/0d1ccfbd64a15f0b94a69cc383b21358.jpg?ver=1783629629","caption":"Shrivarsheni"},"url":"https:\/\/machinelearningplus.com\/author\/shrivarsheni\/"}]}},"_links":{"self":[{"href":"https:\/\/machinelearningplus.com\/wp-json\/wp\/v2\/posts\/12030","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/machinelearningplus.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/machinelearningplus.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/machinelearningplus.com\/wp-json\/wp\/v2\/users\/14"}],"replies":[{"embeddable":true,"href":"https:\/\/machinelearningplus.com\/wp-json\/wp\/v2\/comments?post=12030"}],"version-history":[{"count":0,"href":"https:\/\/machinelearningplus.com\/wp-json\/wp\/v2\/posts\/12030\/revisions"}],"wp:attachment":[{"href":"https:\/\/machinelearningplus.com\/wp-json\/wp\/v2\/media?parent=12030"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/machinelearningplus.com\/wp-json\/wp\/v2\/categories?post=12030"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/machinelearningplus.com\/wp-json\/wp\/v2\/tags?post=12030"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}