fix: use an appropriate column filter list for schema validation (#350)

[ajwelch4]

• fix: use an appropriate column filter list for schema validation (BigQuery Schema Validation Keyword Exception for Table with Records and Repeated Fields #350)
  • Here is the full traceback I was a able to reproduce:

    Traceback (most recent call last):
      File "/home/ajwelch/professional-services-data-validator/env/bin/data-validation", line 33, in <module>
        sys.exit(load_entry_point('google-pso-data-validator', 'console_scripts', 'data-validation')())
      File "/home/ajwelch/professional-services-data-validator/data_validation/__main__.py", line 397, in main
        validate(args)
      File "/home/ajwelch/professional-services-data-validator/data_validation/__main__.py", line 376, in validate
        run(args)
      File "/home/ajwelch/professional-services-data-validator/data_validation/__main__.py", line 357, in run
        run_validations(args, config_managers)
      File "/home/ajwelch/professional-services-data-validator/data_validation/__main__.py", line 333, in run_validations
        run_validation(config_manager, verbose=args.verbose)
      File "/home/ajwelch/professional-services-data-validator/data_validation/__main__.py", line 322, in run_validation
        validator.execute()
      File "/home/ajwelch/professional-services-data-validator/data_validation/data_validation.py", line 101, in execute
        return self.result_handler.execute(self.config, result_df)
      File "/home/ajwelch/professional-services-data-validator/data_validation/result_handlers/text.py", line 61, in execute
        self.print_formatted_(result_df)
      File "/home/ajwelch/professional-services-data-validator/data_validation/result_handlers/text.py", line 46, in print_formatted_
        result_df.drop(self.cols_filter_list, axis=1).to_markdown(
      File "/home/ajwelch/professional-services-data-validator/env/lib/python3.9/site-packages/pandas/core/frame.py", line 4308, in drop
        return super().drop(
      File "/home/ajwelch/professional-services-data-validator/env/lib/python3.9/site-packages/pandas/core/generic.py", line 4153, in drop
        obj = obj._drop_axis(labels, axis, level=level, errors=errors)
      File "/home/ajwelch/professional-services-data-validator/env/lib/python3.9/site-packages/pandas/core/generic.py", line 4188, in _drop_axis
        new_axis = axis.drop(labels, errors=errors)
      File "/home/ajwelch/professional-services-data-validator/env/lib/python3.9/site-packages/pandas/core/indexes/base.py", line 5591, in drop
        raise KeyError(f"{labels[mask]} not found in axis")
    KeyError: "['labels' 'pct_threshold'] not found in axis"
    ``
    

• fix: only reference use_random_row and random_row_batch_size args if we are not doing a schema validation
  • fixes the following traceback:

    Traceback (most recent call last):
      File "/home/ajwelch/professional-services-data-validator/env/bin/data-validation", line 33, in <module>
        sys.exit(load_entry_point('google-pso-data-validator', 'console_scripts', 'data-validation')())
      File "/home/ajwelch/professional-services-data-validator/data_validation/__main__.py", line 394, in main
        validate(args)
      File "/home/ajwelch/professional-services-data-validator/data_validation/__main__.py", line 373, in validate
        run(args)
      File "/home/ajwelch/professional-services-data-validator/data_validation/__main__.py", line 349, in run
        config_managers = build_config_managers_from_args(args)
      File "/home/ajwelch/professional-services-data-validator/data_validation/__main__.py", line 170, in build_config_managers_from_args
        use_random_rows=args.use_random_row,
    AttributeError: 'Namespace' object has no attribute 'use_random_row'