python Programming Glossary: pandas

http://stackoverflow.com/questions/10715965/add-one-row-in-a-pandas-dataframe

one row in a pandas.DataFrame I understand that pandas is designed to load fully.. one row in a pandas.DataFrame I understand that pandas is designed to load fully populated DataFrame but I need to.. with different columns type Answer from @aix hint row pandas.DataFrame dict lib 'hello' qty1 4.0 qty2 100.0 res res.append..

Large, persistent DataFrame in pandas

http://stackoverflow.com/questions/11622652/large-persistent-dataframe-in-pandas

persistent DataFrame in pandas I am exploring switching to python and pandas as a long time.. in pandas I am exploring switching to python and pandas as a long time SAS user. However when running some tests today.. was surprised that python ran out of memory when trying to pandas.read_csv a 128mb csv file. It had about 200 000 rows and 200..

“Large data” work flows using pandas

http://stackoverflow.com/questions/14262433/large-data-work-flows-using-pandas

Large data&rdquo work flows using pandas I have tried to puzzle out an answer to this question for many.. an answer to this question for many months while learning pandas. I use SAS for my day to day work and it is great for it's out.. One day I hope to replace my use of SAS with python and pandas but I currently lack an out of core workflow for large datasets...

What determines whether different Python processes are assigned to the same or different cores?

http://stackoverflow.com/questions/15639779/what-determines-whether-different-python-processes-are-assigned-to-the-same-or-d

turns out that certain Python modules numpy scipy tables pandas skimage ... mess with core affinity on import. As far as I can..

Read Specific Columns from csv file with Python csv

http://stackoverflow.com/questions/16503560/read-specific-columns-from-csv-file-with-python-csv

I would like to take this time to introduce you to the pandas module. Pandas is spectacular for dealing with csv files and.. a csv and save an entire column into a variable import pandas as pd df pd.read_csv csv_file saved_column df.column_name #you..

Converting a Pandas GroupBy object to DataFrame

http://stackoverflow.com/questions/10373660/converting-a-pandas-groupby-object-to-dataframe

a Pandas GroupBy object to DataFrame I'm starting with input data like..

NumPy or Pandas: Keeping array type as integer while having a NaN value

http://stackoverflow.com/questions/11548005/numpy-or-pandas-keeping-array-type-as-integer-while-having-a-nan-value

or Pandas Keeping array type as integer while having a NaN value Is there.. particular I am converting an in house data structure to a Pandas DataFrame. In our structure we have integer type columns that..

Python pandas, widen output display?

http://stackoverflow.com/questions/11707586/python-pandas-widen-output-display

mode Specifically I am using the describe function on a Pandas dataframe. When the dataframe is 5 columns labels wide I get.. IDLE width options to no avail. My purpose in using Pandas and describe is to avoid using a second program like STATA to.. manipulation and investigation. Thanks. Python IDLE 2.7.3 Pandas 0.8.1 Notepad 6.1.4 UNICODE Windows Vista SP2 python pandas..

Selecting rows from a Pandas dataframe with a compound (hierarchical) index

http://stackoverflow.com/questions/11941492/selecting-rows-from-a-pandas-dataframe-with-a-compound-hierarchical-index

rows from a Pandas dataframe with a compound hierarchical index I'm suspicious.. the incantation that will let me select rows from a Pandas dataframe based on the values of a hierarchical key. So for.. with an index. So maybe I should think of this like a Pandas series with a hierarchical index df 'a' 'c' Nope. That fails..

Pandas: create two new columns in a dataframe with values calculated from a pre-existing column

http://stackoverflow.com/questions/12356501/pandas-create-two-new-columns-in-a-dataframe-with-values-calculated-from-a-pre

create two new columns in a dataframe with values calculated..

How to apply a function to two columns of Pandas dataframe

http://stackoverflow.com/questions/13331698/how-to-apply-a-function-to-two-columns-of-pandas-dataframe

to apply a function to two columns of Pandas dataframe Suppose I have a df which has columns of 'ID' 'col_1'.. somewhat like df 'col_3' df 'col_1' 'col_2' .apply f # Pandas gives TypeError ' lambda takes exactly 2 arguments 1 given '..

“Large data” work flows using pandas

http://stackoverflow.com/questions/14262433/large-data-work-flows-using-pandas

are typically too large to fit in memory. In order to use Pandas I would like to read subsets of this data usually just a few..

How to write Pandas dataframe to sqlite with Index

http://stackoverflow.com/questions/14431646/how-to-write-pandas-dataframe-to-sqlite-with-index

to write Pandas dataframe to sqlite with Index I have a list of stockmarket.. 13.95 Based on my reading of the write_frame code for Pandas it does not currently support writing the index . I've attempted.. see code and result below . I'm relatively new to Python Pandas and Numpy so it is entirely possible I'm missing something obvious...

merging two tables with millions of rows in python

http://stackoverflow.com/questions/14614512/merging-two-tables-with-millions-of-rows-in-python

and UNIX RedHat . I finally tried with the combination of Pandas and PyTables by writing table B to disk and then iterating over..

Read Specific Columns from csv file with Python csv

http://stackoverflow.com/questions/16503560/read-specific-columns-from-csv-file-with-python-csv

to take this time to introduce you to the pandas module. Pandas is spectacular for dealing with csv files and the following..

Pandas: reshaping data

http://stackoverflow.com/questions/16637171/pandas-reshaping-data

reshaping data I have a pandas Series which presently looks..

Pandas nested sort and NaN

http://stackoverflow.com/questions/17126500/pandas-nested-sort-and-nan

nested sort and NaN I'm trying to understand the expected behavior.. pandas share improve this question Until fixed in Pandas this is what I'm using for sorting for my needs with a subset..

Intraday candlestick charts using MatPlotLib

http://stackoverflow.com/questions/9673988/intraday-candlestick-charts-using-matplotlib

from 5minutes to 30 minutes. Edit I have also made a Pandas dataframe of the data not sure if pandas has candlestick functionality...