v1.3.4

DataFrames v1.3.4

Diff since v1.3.3

Closed issues:

• stack not catching invalid value of keyword variable_eltype (#3042)

Merged pull requests:

• Fix handling of variable_eltype in stack (#3043) (@bkamins)

v1.3.3

DataFrames v1.3.3

Closed issues:

• outerjoin: keyword augument matchmissing not correctly passed (#3039)

Merged pull requests:

• make sure we correctly pass matchmissing in joins (#3040) (@bkamins)

v1.3.2

DataFrames v1.3.2

Diff since v1.3.1

Closed issues:

• Variance in runtime reduction functions (#2956)
• use of map in ByRow (#2957)
• Replace and Missing Values (#2976)
• Subset and Missing Values (#2977)
• copying of columns in select! and transform! (#2978)
• Unexpected Behavior of Combined Column Selection (#2980)

Merged pull requests:

• Add a note about df.col .= v broadcasting changes (#2971) (@bkamins)
• Update working_with_dataframes.md (#2973) (@alfaromartino)
• Clean up join code (#2975) (@bkamins)
• Add links to docs, rephrase a bit (#2979) (@nalimilan)
• fix aliasing detection in sort! (#2981) (@bkamins)
• make sure ByRow invokes generic map (#2982) (@bkamins)
• make sure we use source column only once (#2983) (@bkamins)
• Update subset to handle large number of selectors better (#2989) (@bkamins)

v1.3.1

DataFrames v1.3.1

Diff since v1.3.0

Closed issues:

• Decide if we want to rename All to Cols (#2203)
• Creating new columns on a view should fill in missings everywhere else. (#2211)
• Consider allowing to sort! a SubDataFrame (#2300)
• Locate the problem in disallowmissing error (#2965)
• Arrow Notation within Column Selection is Inconsistent (#2969)

Merged pull requests:

• fix: change "dont" to "don't" (#2962) (@Mo-Gul)
• better disallowmissing error message (#2966) (@bkamins)
• fix issues with parameter type printing in doctests (#2967) (@bkamins)
• update docs for join on (left, right) tuple (#2968) (@visr)
• fix getindex with vector of Pairs (#2970) (@bkamins)

v1.3.0

DataFrames v1.3.0

Diff since v1.2.2

Closed issues:

• Port pqr benchmarks (#298)
• Memory efficiency of join (#1334)
• Selections.jl + DataFrames.jl (#1936)
• Add support for All, Between and Not broadcating (#2171)
• filter(df, :x => f) would be useful to have (#2187)
• allow selector => fun1 => fun2 in select and combine (#2207)
• add a leftjoin! (or match! or merge! or whatever it should be called) (#2259)
• Provide a syntax to perform row aggregations fast (#2439)
• Investigate performance of aggregations (#2440)
• Rework the manual (#2595)
• Add after keyword argument to insertcols! (#2613)
• control fill value for missing cells in unstack (#2698)
• Allow selecting columns based on predicate on column contents (#2747)
• Fast row aggregation in DataFrames.jl (#2768)
• Add a method to add/insert empty columns (#2783)
• Assignment to SubDataFrame (#2785)
• DataFrameMacros.jl and DataFramesMeta.jl (#2793)
• DataFrames not threadsafe (#2795)
• Better documentation for combine(gd, fun => :x) (#2830)
• AsTable in combine seems to require at least one column (#2832)
• implement Tables.materializer(::Type{<:AbstractDataFrame})? (#2833)
• Should ByRow use map or not (#2834)
• Error for unstacking an empty dataframe (#2841)
• The test/show.jl tests fail when Julia is started with julia --color=no (#2846)
• Faster count (#2849)
• AsTable docstring doesn't mention it can be used as a target for select etc. (#2850)
• delete! in DataFrames.jl (#2853)
• Import nrow and ncol from DataAPI.jl (#2855)
• Support the Case of Matrix{Any} as Data and Vector{Any} as Header (#2858)
• Allow DataFrame(matrix, names, copycols=false) (#2860)
• Displaying DateTime columns (#2861)
• update docs to CSV.jl 0.9 (#2864)
• Better error messages when frame is empty (#2867)
• Add "Filtering" section to the documentation User Guide. (#2871)
• Add documentation for transformation functions without the Split-Apply-Combine strategy to User Guide. (#2872)
• Make Cols more flexible (#2875)
• In src => fun => dst allow transformation function in dst (#2876)
• Ambiguity error between CategoricalArrays and SentinelArrays (#2883)
• ByRow and transform not working (#2884)
• Avoid mixing standard and scientific floats in output (#2885)
• Updating ClassImbalance.jl; Needed help debugging (#2886)
• mixing :x => :y and :x => f => :y syntax in vector to select errors (#2888)
• Trimming variables in a data frame (#2891)
• renamecols function for transform (#2893)
• TableOperations.joinpartitions doesn't work properly (#2895)
• Correct isiterable(DataFrame) (#2896)
• Strange behaviour with non-ASCII column names (#2901)
• tf keyword argument from PrettyTables.jl does not work in DataFrames.jl show function. (#2903)
• Aggregate function with multiple output columns of different types (#2905)
• Recommend PooledArrays to pool data (#2908)
• update DataFramesMeta.jl docs (#2910)
• Add contributing opportunities to the contributing guide (#2912)
• Default show truncates too soon (#2913)
• DataFrames logo banner (#2917)
• Regenerate precompile statements for 1.3 release (#2921)
• subset doesn't accept a vector of transformations (#2924)
• Printing of data frames in try-catch (#2925)
• Modifying transformations with grouped dataframes (#2927)
• Improve filter docs (#2930)
• Improve sort docs (#2931)
• DataFrames errors on loading with --depwarn=error (#2935)
• Add AsTable([:a, :b]) => AsTable (#2939)
• Grouped describe fails or "clashes" with StatsBase (#2952)

Merged pull requests:

• Add standard deviation and 25% and 75% quantiles to describe :detailed (#2459) (@nalimilan)
• Support adding columns to views (#2794) (@bkamins)
• Add muli-threading support description to the manual (#2823) (@bkamins)
• feat: unstack receives kwarg fillvalue (#2828) (@pstorozenko)
• feat: insertcols! receives kwarg after (#2829) (@pstorozenko)
• explain that fun => target does not work in general (#2836) (@bkamins)
• more careful test of ByRow for PooledArray (#2837) (@bkamins)
• fix transformation minilanguage docs (#2838) (@bkamins)
• add Tables.materializer for types methods (#2839) (@bkamins)
• Fix typo math => match (#2840) (@Nosferican)
• Fix empty unstack on empty data frame (#2842) (@bkamins)
• Bk/add leftjoin! (#2843) (@bkamins)
• Fix tests broken by Julia Base changes (#2844) (@bkamins)
• Disable color testing when color is not supported (#2847) (@bkamins)
• Improve docstring of AsTable (#2851) (@bkamins)
• Fix three uses of "data table" (#2852) (@nalimilan)
• deprecate delete!, define deleteat! (#2854) (@bkamins)
• use nrow and ncol from DataAPI.j (#2856) (@bkamins)
• Fix signature of constructor in docstring (#2857) (@nalimilan)
• make DataFrame constructor more flexible (#2859) (@bkamins)
• fix transpose error message and clean up code (#2862) (@bkamins)
• Update to latest GA for docs (#2863) (@quinnj)
• update docs following CSV.jl 0.9 release (#2865) (@bkamins)
• code cleanup to improve error messages (#2868) (@bkamins)
• Add fast reductions (#2869) (@bkamins)
• fix: typo (#2873) (@kunzaatko)
• fix: do not copy syntax is with ! (#2874) (@kunzaatko)
• Allow constructing Matrix from empty dataframe (#2878) (@jakobnissen)
• Fix typo in NEWS.md (#2880) (@bkamins)
• Allow predicate in Cols (#2881) (@bkamins)
• Improve docstring for names() (#2882) (@xluo127)
• avoid not specialized Pair issue (#2889) (@bkamins)
• Specify why leftjoin! needs at most one match (#2894) (@rikhuijzer)
• allow transformation destination to be a function (#2897) (@bkamins)
• improve docs alignment (#2898) (@bkamins)
• improve missings documentation (#2899) (@bkamins)
• add filter and subset to documentation (#2900) (@bkamins)
• Try to detect unicode normalization issues in column names (#2904) (@bkamins)
• Faster computation of quantiles in describe (#2909) (@nalimilan)
• add info about PooledArrays (#2911) (@bkamins)
• Add more guidance for new contributors (#2914) (@bkamins)
• Update Querying frameworks DataFramesMeta.jl docs (#2915) (@pdeffebach)
• hardening haskey (#2916) (@bkamins)
• Add broadcasting of selectors to the minilanguage (#2918) (@bkamins)
• Add general fast aggregation for wide tables with collect (#2920) (@bkamins)
• Fix tests of names (#2922) (@bkamins)
• Update ci.yml in preparation of Julia 1.6 LTS (#2923) (@bkamins)
• Allow passing multiple columns to subset (#2926) (@bkamins)
• docs: fix typo and add some newlines in tutorial (#2932) (@rfourquet)
• mention ClipData.jl (#2933) (@Datseris)
• Correctly handle functors when auto-generating column names (#2934) (@bkamins)
• plan for a change in broadcasting rules in Julia 1.7 (#2937) (@bkamins)
• Change join tests to reduce memory consumption (#2938) (@bkamins)
• Improve Docstrings for sort and sort! (#2940) (@Chandu-4444)
• Add examples for issorted docstrings. (#2941) (@Chandu-4444)
• Add row indexing to filter docstring and examples. (#2942) (@nathanrboyer)
• Reduce test memory usage (#2943) (@bkamins)
• Add reverse prototype (#2944) (@Chandu-4444)
• Define sort! for AbstractDataFrame and fix issues of kwargs in sorting functions (#2946) (@bkamins)
• Make transformation docstring more precise (#2948) (@bkamins)
• Catch OutOfMemoryError (#2949) (@bkamins)
• clean up source code (#2950) (@bkamins)
• Add view kwarg to first and last (#2951) (@Chandu-4444)
• Generate precompile statements for Julia 1.7 (#2955) (@bkamins)

v1.2.2

DataFrames v1.2.2

Diff since v1.2.1

Closed issues:

• Add method to filter on Bool column symbols (#2465)
• Enable documenter doctests (#2702)
• Extend => renaming syntax (#2728)
• add a keyword to specify group order in groupby (#2762)
• subset with grouped data frame has worse compile times than transform (#2806)
• Performance Issues with filter and subset (#2821)
• Extremely slow GroupBy behaviour on a small table (#2822)
• Is there any Julia alternatives to to_dict function in pandas? (#2824)

Merged pull requests:

• making a new top level section to work with DataFrames (#2717) (@RohitRathore1)
• make sort kwarg in groupby more flexible (#2812) (@bkamins)
• add a link to JuliaCon2021 tutorial to docs (#2817) (@bkamins)
• review of the DataFrames.jl tutorial (#2825) (@bkamins)
• correct signature of merge for AbstractIndex (#2826) (@bkamins)

v1.2.1

DataFrames v1.2.1

Diff since v1.2.0

Closed issues:

• "transform" function not available (#2815)
• How to change the value of a cell to a different data type? (#2816)
• dropmissing! creates weird memory bugs/errors on 1.7 and 1.6 (#2819)

Merged pull requests:

• Document GroupedDataFrame consistency check (#2811) (@bkamins)
• fix delete! for versions of Julia 1.6.2 or earlier (#2820) (@bkamins)

v1.2.0

DataFrames v1.2.0

Diff since v1.1.1

Closed issues:

• Add matchmissing = :notequal option (#2650)
• Implement pushfirst! to allow appending rows in the beginning of a DataFrame (#2678)
• Review comparisons with R/Python (#2737)
• Slow sorts in columns with Union{<:Any, missing} even if no missing values in the column (#2745)
• Display complex numbers - alignment (#2754)
• Slow row aggregation in presence of missings (#2757)
• Convert column from string to float (#2761)
• Improve SubDataFrame creation for AbstractVector{Bool} (#2765)
• Flatten in case column contains string and array (#2766)
• Question: Small Delimited file into DataFrame (#2772)
• transform(df, :x => AsTable)` should probably work (#2779)
• missing method combine(gd::GroupedDataFrame, ::Matrix) (#2781)
• Sync with DataAPI.jl 1.7 release (#2788)
• inconsistency of groupby() for -0.0 (#2790)
• Clean up precompile statements (#2792)
• Test failures when using julia --color=no (#2796)
• Differently typed columns when using DataFrame(myVector) vs DataFrame(x = myVector) (#2798)
• DataFrame(table) != DataFrame(table, copycols=true) (#2799)
• html dataframe representation includes invalid placement of <p> tag (#2800)
• subset!(gd::GroupedDataFrame, ...) should make sure gd still works after (#2808)

Merged pull requests:

• Matchmissing == :notequal (#2724) (@pstorozenko)
• Update comparisons with data.table info (#2725) (@eloualiche)
• Run findall(rows) only if rows are not all true (#2727) (@pstorozenko)
• Fix type instability in sort for few columns case and fix issorted bug (#2746) (@bkamins)
• Cover corner case of compactype (wide name and CategoricalValue) (#2751) (@bkamins)
• Update docs URLs in README (#2752) (@ViralBShah)
• reviewed and fixed (#2755) (@RohitRathore1)
• Alignment of complex numbers (#2756) (@ronisbr)
• audit more master -> main (#2758) (@Moelf)
• make "Edit on Github" points to main branch (#2759) (@Moelf)
• Mark outdated docs (#2760) (@pfitzseb)
• update NEWS.md (#2763) (@bkamins)
• add _findall for AbstractVector{Bool} and use it in internal functions (#2769) (@bkamins)
• Explicit loop in _findall to avoid allocations (#2771) (@pstorozenko)
• add information how DelimitedFiles can be used (#2773) (@bkamins)
• Put longer type into th title argument in HTML show (#2774) (@mortenpi)
• Deprecate AbstractVector in hcat (#2777) (@bkamins)
• remove escape in Char (#2778) (@bkamins)
• allow :col => AsTable and :col => cols (#2780) (@bkamins)
• allow Matrices in transformations of GroupedDataFrame (#2782) (@bkamins)
• Use latest Documenter.jl (#2786) (@bkamins)
• Fix float grouping (#2791) (@bkamins)
• Use standard Tables.Schema constructor instead of constructing directly (#2797) (@quinnj)
• move summary outside of a in text/html (#2801) (@bkamins)
• Add some clarifying comments on copycols for Tables.jl inputs (#2805) (@quinnj)
• up DataAPI.jl to 1.7 and CategoricalArrays.jl to 0.10.0 (#2807) (@bkamins)
• improve subset! for GroupedDataFrame (#2809) (@bkamins)
• update precompilation and .gitignore (#2810) (@bkamins)

v1.1.1

DataFrames v1.1.1

Diff since v1.1.0

Closed issues:

• DataFrames with many columns are too slow (because of show()) (#2739)
• Unable to install DataFrames: error regarding ComposedFunction (#2748)

Merged pull requests:

• Optimize completecases to process only missingable columns (#2726) (@pstorozenko)
• fix performance issue in multirow split-apply-combine (#2749) (@bkamins)
• use dict to cache eltype names (#2750) (@bkamins)

v1.1.0

DataFrames v1.1.0

Diff since v1.0.2

Merged pull requests:

• require AbstractVector from subset selectors (#2744) (@bkamins)