-
-
Notifications
You must be signed in to change notification settings - Fork 144
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
WIP: Preliminary investigation: updating to python 3 #1407
WIP: Preliminary investigation: updating to python 3 #1407
Commits on Sep 15, 2020
-
feat(BTE):Init cl-binary-transformers-and-extractors
Add new docker image to CL Add simple test to begin replacing weird binaries
Configuration menu - View commit details
-
Copy full SHA for 7896fe9 - Browse repository at this point
Copy the full SHA 7896fe9View commit details -
refactor(make_png_thumbnail..): Use docker BTE
Use our new docker container to generate the thumbnail and return the contents
Configuration menu - View commit details
-
Copy full SHA for 36f3b8f - Browse repository at this point
Copy the full SHA 36f3b8fView commit details -
Configuration menu - View commit details
-
Copy full SHA for f952859 - Browse repository at this point
Copy the full SHA f952859View commit details
Commits on Sep 16, 2020
-
refactor(scrapers/tasks): Remove subprocess methods
Refactor subprocess into our new BTE container
Configuration menu - View commit details
-
Copy full SHA for 40053f2 - Browse repository at this point
Copy the full SHA 40053f2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8db9b46 - Browse repository at this point
Copy the full SHA 8db9b46View commit details -
Configuration menu - View commit details
-
Copy full SHA for c8775b9 - Browse repository at this point
Copy the full SHA c8775b9View commit details -
refactor(get_page_count): Add extension param
Not sure its necessary or used in any way The method only extracts page count for PDFs prior to this refactor.
Configuration menu - View commit details
-
Copy full SHA for ee42731 - Browse repository at this point
Copy the full SHA ee42731View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3894abc - Browse repository at this point
Copy the full SHA 3894abcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1983f5d - Browse repository at this point
Copy the full SHA 1983f5dView commit details -
refactor(docker): Update compose files
Add volumes to new containers to task server Remove unneeded installs to task server
Configuration menu - View commit details
-
Copy full SHA for 3576775 - Browse repository at this point
Copy the full SHA 3576775View commit details
Commits on Sep 17, 2020
-
Configuration menu - View commit details
-
Copy full SHA for f6cfa5e - Browse repository at this point
Copy the full SHA f6cfa5eView commit details -
refactor(tests.yml):Update tests.yml
Currently tests.yml is not running this is an attempt to get it working in a new syntax
Configuration menu - View commit details
-
Copy full SHA for cbfa9d4 - Browse repository at this point
Copy the full SHA cbfa9d4View commit details -
Configuration menu - View commit details
-
Copy full SHA for dec2f1b - Browse repository at this point
Copy the full SHA dec2f1bView commit details -
Configuration menu - View commit details
-
Copy full SHA for fd4781f - Browse repository at this point
Copy the full SHA fd4781fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 716e6a8 - Browse repository at this point
Copy the full SHA 716e6a8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 56f0cb7 - Browse repository at this point
Copy the full SHA 56f0cb7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4cefe43 - Browse repository at this point
Copy the full SHA 4cefe43View commit details -
tests(cl/docker-compose): Test bte_beta containers
Built and pushed beta containers for Django and the celery task-server. Task server is imported from django image and neither has the 'weird binaries'. The new images are 36% of the old ones
Configuration menu - View commit details
-
Copy full SHA for aca26b5 - Browse repository at this point
Copy the full SHA aca26b5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 19a3aed - Browse repository at this point
Copy the full SHA 19a3aedView commit details -
Configuration menu - View commit details
-
Copy full SHA for 06d9be7 - Browse repository at this point
Copy the full SHA 06d9be7View commit details -
refactor(docker-compose): Add env variables
Add JUDGE_PICS_PATH add SEAL_ROOKERY_PATH
Configuration menu - View commit details
-
Copy full SHA for 581b51b - Browse repository at this point
Copy the full SHA 581b51bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 87eaee6 - Browse repository at this point
Copy the full SHA 87eaee6View commit details
Commits on Sep 18, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 2de8519 - Browse repository at this point
Copy the full SHA 2de8519View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2773d96 - Browse repository at this point
Copy the full SHA 2773d96View commit details -
Configuration menu - View commit details
-
Copy full SHA for effa9ee - Browse repository at this point
Copy the full SHA effa9eeView commit details -
Configuration menu - View commit details
-
Copy full SHA for e594219 - Browse repository at this point
Copy the full SHA e594219View commit details -
Configuration menu - View commit details
-
Copy full SHA for a1dc92e - Browse repository at this point
Copy the full SHA a1dc92eView commit details -
Configuration menu - View commit details
-
Copy full SHA for ae2a90b - Browse repository at this point
Copy the full SHA ae2a90bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 53faffc - Browse repository at this point
Copy the full SHA 53faffcView commit details
Commits on Sep 19, 2020
-
fix(settings): Add Binary Transformers & Extractors
Add BTE URL to settings and point to it in functions
Configuration menu - View commit details
-
Copy full SHA for 9446c20 - Browse repository at this point
Copy the full SHA 9446c20View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6dd8f2c - Browse repository at this point
Copy the full SHA 6dd8f2cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 128ac81 - Browse repository at this point
Copy the full SHA 128ac81View commit details
Commits on Sep 21, 2020
-
refactor(get_page_count): Update get_page_count params
Remove extension from get_page_count
Configuration menu - View commit details
-
Copy full SHA for ba4d61e - Browse repository at this point
Copy the full SHA ba4d61eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9f71d61 - Browse repository at this point
Copy the full SHA 9f71d61View commit details -
refactor(generate_thumbnail): Change error handling
Remove error catching from generate thumnail method. Move exceptions to the calling code.
Configuration menu - View commit details
-
Copy full SHA for e9c4125 - Browse repository at this point
Copy the full SHA e9c4125View commit details -
Configuration menu - View commit details
-
Copy full SHA for 91b7937 - Browse repository at this point
Copy the full SHA 91b7937View commit details
Commits on Sep 29, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 442675b - Browse repository at this point
Copy the full SHA 442675bView commit details -
Configuration menu - View commit details
-
Copy full SHA for f167de3 - Browse repository at this point
Copy the full SHA f167de3View commit details
Commits on Sep 30, 2020
-
fix(transformer_extractor_utils): Add filename discovery to post corr…
…ect file type to bte
Configuration menu - View commit details
-
Copy full SHA for ffaf8f1 - Browse repository at this point
Copy the full SHA ffaf8f1View commit details -
Configuration menu - View commit details
-
Copy full SHA for a71a001 - Browse repository at this point
Copy the full SHA a71a001View commit details -
fix(tests.py): Update document extraction test
Check to validate successful response from BTE
Configuration menu - View commit details
-
Copy full SHA for 0e87056 - Browse repository at this point
Copy the full SHA 0e87056View commit details -
Configuration menu - View commit details
-
Copy full SHA for 50831fe - Browse repository at this point
Copy the full SHA 50831feView commit details -
fix(scrapers/tests): Fix test_txt_extraction_with_bad_data
Update test to reflect BTE changes
Configuration menu - View commit details
-
Copy full SHA for 32ddcd8 - Browse repository at this point
Copy the full SHA 32ddcd8View commit details
Commits on Oct 1, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 911948f - Browse repository at this point
Copy the full SHA 911948fView commit details -
2to3: convert to py3 unicode handling.
Remove `u` prefix from unicode strings - all strings are unicode. Change `unicode(...)` to `str(...)`. Change `isinstance(x, basestring)` to `isinstance(x, str)`.
Configuration menu - View commit details
-
Copy full SHA for 5b5f904 - Browse repository at this point
Copy the full SHA 5b5f904View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4e407d5 - Browse repository at this point
Copy the full SHA 4e407d5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4bb8e13 - Browse repository at this point
Copy the full SHA 4bb8e13View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4bab940 - Browse repository at this point
Copy the full SHA 4bab940View commit details -
Configuration menu - View commit details
-
Copy full SHA for d87fdc5 - Browse repository at this point
Copy the full SHA d87fdc5View commit details -
2to3: Convert iterators to lists where necessary.
Some functions, particularly those on dicts like `d.items()` and `d.values()` return iterators, not lists. In some circumstances (i.e. when you're not immediately iterating through the results) you need to construct the list with `list(...)` to work with py3.
Configuration menu - View commit details
-
Copy full SHA for 463cad5 - Browse repository at this point
Copy the full SHA 463cad5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1185caa - Browse repository at this point
Copy the full SHA 1185caaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 760cc1e - Browse repository at this point
Copy the full SHA 760cc1eView commit details -
Library replacements: StringIO, httplib, HTMLParser, urlparse
httplib => http.client HTMLParser => html.parser cStringIO, StringIO => io.StringIO urlparse => urllib.parse urllib2 => urllib.error izip => builtin zip
Configuration menu - View commit details
-
Copy full SHA for be5bc1e - Browse repository at this point
Copy the full SHA be5bc1eView commit details -
Configuration menu - View commit details
-
Copy full SHA for dde5826 - Browse repository at this point
Copy the full SHA dde5826View commit details -
Starting number with '0' is invalid.
I didn't think this was a Python 2 vs. 3 thing but hey.
Configuration menu - View commit details
-
Copy full SHA for dbeba70 - Browse repository at this point
Copy the full SHA dbeba70View commit details -
Configuration menu - View commit details
-
Copy full SHA for 64a1962 - Browse repository at this point
Copy the full SHA 64a1962View commit details -
Convert dunders to py3: __bool__, __str__.
__nonzero__ => __bool__ __unicode__ => __str__
Configuration menu - View commit details
-
Copy full SHA for 4e4deec - Browse repository at this point
Copy the full SHA 4e4deecView commit details -
Configuration menu - View commit details
-
Copy full SHA for e0ea84c - Browse repository at this point
Copy the full SHA e0ea84cView commit details -
feat(convert_audio): Update convert audio BTE call
Update method to call for audio conversion. Includes a serializer for passing the necessary information to BTE.
Configuration menu - View commit details
-
Copy full SHA for 197450b - Browse repository at this point
Copy the full SHA 197450bView commit details
Commits on Oct 2, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 6865a0e - Browse repository at this point
Copy the full SHA 6865a0eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6ff9832 - Browse repository at this point
Copy the full SHA 6ff9832View commit details -
Configuration menu - View commit details
-
Copy full SHA for c65ba73 - Browse repository at this point
Copy the full SHA c65ba73View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7cecd27 - Browse repository at this point
Copy the full SHA 7cecd27View commit details -
Configuration menu - View commit details
-
Copy full SHA for 971f36e - Browse repository at this point
Copy the full SHA 971f36eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 78d7734 - Browse repository at this point
Copy the full SHA 78d7734View commit details -
Rename submodule
ca9-briefs
toca9_briefs
.Using dashes in submodule names isn't valid Python (2 or 3, I think).
Configuration menu - View commit details
-
Copy full SHA for 4529517 - Browse repository at this point
Copy the full SHA 4529517View commit details -
refactor(req.txt): Remove unused imports
Seal-rookery, and eyed3 are not needed anymore
Configuration menu - View commit details
-
Copy full SHA for f2151d9 - Browse repository at this point
Copy the full SHA f2151d9View commit details -
Configuration menu - View commit details
-
Copy full SHA for edfe701 - Browse repository at this point
Copy the full SHA edfe701View commit details -
refactor(scrapers/tests.py): Update tests
add test_BTE_audio_conversion for audio conversion and metadata addition
Configuration menu - View commit details
-
Copy full SHA for 2a20c2d - Browse repository at this point
Copy the full SHA 2a20c2dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 51f26da - Browse repository at this point
Copy the full SHA 51f26daView commit details -
Configuration menu - View commit details
-
Copy full SHA for 930267c - Browse repository at this point
Copy the full SHA 930267cView commit details -
Merge branch 'pr/1407' into python38-merger
# Conflicts: # cl/scrapers/tasks.py # cl/search/management/commands/cl_count_recap_pages.py
Configuration menu - View commit details
-
Copy full SHA for efc0d2b - Browse repository at this point
Copy the full SHA efc0d2bView commit details -
feat(CL):Add python3.8 support
Building on @drewsilcock I merged his branch with the dockerize weird binaries modified juriscraper slightly and voila. I havent tested it out but it will load the homepage and search solr.
Configuration menu - View commit details
-
Copy full SHA for d082862 - Browse repository at this point
Copy the full SHA d082862View commit details
Commits on Oct 5, 2020
-
Tweaks to get tests to partially run
Include changes to migration files help text encoding
Configuration menu - View commit details
-
Copy full SHA for e3207da - Browse repository at this point
Copy the full SHA e3207daView commit details -
Tweaks to get tests to partially run
Include changes to migration files help text encoding
Configuration menu - View commit details
-
Copy full SHA for d970773 - Browse repository at this point
Copy the full SHA d970773View commit details -
Merge branch 'python38-merger' of github.com:freelawproject/courtlist…
…ener into python38-merger
Configuration menu - View commit details
-
Copy full SHA for ae9989f - Browse repository at this point
Copy the full SHA ae9989fView commit details -
Merge branch 'python38-merger' of github.com:freelawproject/courtlist…
…ener into python38-merger
Configuration menu - View commit details
-
Copy full SHA for 515d6c9 - Browse repository at this point
Copy the full SHA 515d6c9View commit details -
Merge branch 'python38-merger' of github.com:freelawproject/courtlist…
…ener into python38-merger
Configuration menu - View commit details
-
Copy full SHA for a558eb9 - Browse repository at this point
Copy the full SHA a558eb9View commit details
Commits on Oct 6, 2020
-
Configuration menu - View commit details
-
Copy full SHA for df07471 - Browse repository at this point
Copy the full SHA df07471View commit details -
Configuration menu - View commit details
-
Copy full SHA for b2e61bb - Browse repository at this point
Copy the full SHA b2e61bbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d18148 - Browse repository at this point
Copy the full SHA 5d18148View commit details -
Configuration menu - View commit details
-
Copy full SHA for 94c42a5 - Browse repository at this point
Copy the full SHA 94c42a5View commit details -
Merge branch 'python38-merger' of github.com:freelawproject/courtlist…
…ener into python38-merger
Configuration menu - View commit details
-
Copy full SHA for a135f03 - Browse repository at this point
Copy the full SHA a135f03View commit details -
Merge branch 'python38-merger' of github.com:freelawproject/courtlist…
…ener into python38-merger
Configuration menu - View commit details
-
Copy full SHA for 5afe86d - Browse repository at this point
Copy the full SHA 5afe86dView commit details -
Merge branch 'python38-merger' of github.com:freelawproject/courtlist…
…ener into python38-merger
Configuration menu - View commit details
-
Copy full SHA for ec66de4 - Browse repository at this point
Copy the full SHA ec66de4View commit details -
refactor(text_filters): Integer division py2-> py3
use // instead of / for integer division
Configuration menu - View commit details
-
Copy full SHA for 95942b5 - Browse repository at this point
Copy the full SHA 95942b5View commit details -
Configuration menu - View commit details
-
Copy full SHA for c152ad9 - Browse repository at this point
Copy the full SHA c152ad9View commit details -
Configuration menu - View commit details
-
Copy full SHA for b293dad - Browse repository at this point
Copy the full SHA b293dadView commit details
Commits on Oct 7, 2020
-
refactor(search_utils): Switch sunburnt for scorched
In cleanup main query and get related clusters with cache replaced sunburnt with scorched
Configuration menu - View commit details
-
Copy full SHA for 813752f - Browse repository at this point
Copy the full SHA 813752fView commit details -
feat(req.txt): Upgrade req txt file
Upgrade scorched, ipython, cryptography and comment out psycopg2
Configuration menu - View commit details
-
Copy full SHA for 76119c4 - Browse repository at this point
Copy the full SHA 76119c4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 804b246 - Browse repository at this point
Copy the full SHA 804b246View commit details -
Configuration menu - View commit details
-
Copy full SHA for f57245d - Browse repository at this point
Copy the full SHA f57245dView commit details -
refactor(cl): Replace magic with magic
Remove old magic code with python magic, add to req.
Configuration menu - View commit details
-
Copy full SHA for 32e025f - Browse repository at this point
Copy the full SHA 32e025fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5a2f288 - Browse repository at this point
Copy the full SHA 5a2f288View commit details -
Configuration menu - View commit details
-
Copy full SHA for 76b7d43 - Browse repository at this point
Copy the full SHA 76b7d43View commit details -
Change dependency specification from pip to poetry.
Where pip needs `==a.b.*,>=a.b.c`, poetry can just do `^a.b.c`. Strictly speaking this isn't exactly the same as `^a.b.c` will satisfy any `a.d.e` where d > b and e > c. This makes the versioning more reliable, because the pip version could install major package updates without you realising.
Configuration menu - View commit details
-
Copy full SHA for 36dd7f9 - Browse repository at this point
Copy the full SHA 36dd7f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 01e79a3 - Browse repository at this point
Copy the full SHA 01e79a3View commit details
Commits on Oct 9, 2020
-
Configuration menu - View commit details
-
Copy full SHA for ff9ccb8 - Browse repository at this point
Copy the full SHA ff9ccb8View commit details