Skip to content
This repository has been archived by the owner on Mar 29, 2023. It is now read-only.

nv-morpheus/dfencoder

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

⚠️ Note: Repository Has Been Archived ⚠️

This repo has been archived and is now read only. The functionality has been moved into the Morpheus repo. You can find the new implementation of the AutoEncoder class inside the morpheus.models.dfencoder module located here.

dfencoder - AutoEncoders for DataFrames

Want to learn useful nonlinear representations of your tabular data? Don't have time to mess with autoencoders? This library aims to simplify your life.

Currently under development.

Installation

We highly recommend using a virtual environment to install! This software has only been tested using python 3.6.

The bare-bones requirements are installed automatically by pip. You may also want to install jupyter and matplotlib to run notebooks and the ipynb logger, but these are not requirements to install.

Install using:

pip install dfencoder



Or, you can get the latest version by cloning this repository and installing from the home directory:

pip install .



Usage

Thorough documntation is still being written, but the demo notebook is available to show some of the features of this library.

Running the tests

The adult.csv dataset is used in the testing script. Make sure the file (found in the root of this repo) is in the same directory as test.py when you run the script.

Contributing

Contributors are welcomed! Please reach out with PRs.

Feature Requests and Bugs

We'd like to release a stable version soon, so in the meantime please submit feature requests and bug reports on this repository's issues page.

Thanks for your interest in this project!

Dataframe Encoding

dfencoder does some manipulation to encode features to feed into the feed-forward MLP. This HLD hopefully clears up how this looks. HLD for how inputs are encoded by dfencoder

Features

This library is a personal project so progress is slow. The latest release as of this writing is v0.0.37 which introduces "inference mode" that optimizes inference for single records, on json inputs.

Previous Releases:

v0.0.36 which introduces handling for timestamp data; will use cyclical encoding to encode time of day, day of week, day of month, day of year, as well as the raw timestamp scaled as a numeric feature to encode raw linear time.

Pre-process your timestamp columns by using pandas: pd.to_datetime() so dfencoder can infer the datatype and handle it accordingly.

About

No description, website, or topics provided.

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Jupyter Notebook 82.1%
  • Python 17.9%