Unsupported OP_QUERY command

[Adityak4201]

I have mongoDB 6.0. When I am trying to connect it from redash 8.0, I am getting error:

Unsupported OP_QUERY command: connectionStatus. The client driver may require an upgrade. For more details, see https://dochub.mongodb.org/core/legacy-opcode-removal.

After going through redash's code, I realized they are using pymongo 3.9.0 which only supports till mongo 4.2. Please upgrade the pymongo version to 4.3.3

[justinclift]

Interesting. Yeah, that pymongo version of 3.9.0 is even in the latest Redash source code:

redash/requirements_all_ds.txt

Line 9 in d63ef90

pymongo[tls,srv]==3.9.0

We're updating other dependencies over the last days and weeks anyway, so we might as well try a newer pymongo and see if it builds without needing other changes.

[justinclift]

@Adityak4201 I've just created a PR with that change, mostly to see if it passes our test suite. No idea if it'll work or not, but it's worth trying out just in case. 😄

[justinclift]

The newer PyMongo passed the current Redash test suite, though I'm not sure how much that actually tests the Mongo part of things. That being said, I've merged it the PR into our master branch, so it's currently re-running the test suite on there + it'll automatically build a new preview docker image:

https://hub.docker.com/r/redashcommunity/redash/tags

You might need to give it an hour or so to finish the tests and building, then you could try that docker build out with your Mongo version 6 data source and see if it works ok. 😄

[justinclift]

It looks like the updated docker hub image has already built, so you should be ok to try it out. 😄

[Adityak4201]

Hey @justinclift. Thanks for the quick response. I will test it and let you know

[justinclift]

Thanks, please do. If the updated PyMongo library doesn't work properly, we'll probably need to change the version back to the older one until we can look at it properly.

[Adityak4201]

I have been trying to run the https://hub.docker.com/r/redashcommunity/redash/tags with docker. I have been following https://redash.io/help/open-source/dev-guide/docker for running the application on docker.

But, when I am running the command docker-compose run --rm server create_db, I am getting the following error:

Starting redash_redis_1 ... done
Starting redash_postgres_1 ... done
Traceback (most recent call last):
File "/app/manage.py", line 6, in
from redash.cli import manager
File "/app/redash/init.py", line 56, in
import_query_runners(settings.QUERY_RUNNERS)
File "/app/redash/query_runner/init.py", line 445, in import_query_runners
import(runner_import)
File "/app/redash/query_runner/dynamodb_sql.py", line 10, in
from dql import Engine, FragmentEngine
File "/usr/local/lib/python3.7/site-packages/dql/init.py", line 6, in
from .cli import DQLClient
File "/usr/local/lib/python3.7/site-packages/dql/cli.py", line 21, in
from .engine import FragmentEngine
File "/usr/local/lib/python3.7/site-packages/dql/engine.py", line 47, in
from .grammar import line_parser, parser
File "/usr/local/lib/python3.7/site-packages/dql/grammar/init.py", line 37, in
from .query import (
File "/usr/local/lib/python3.7/site-packages/dql/grammar/query.py", line 45, in
from .parsed_primitives import primitive as parsed_primitive
File "/usr/local/lib/python3.7/site-packages/dql/grammar/parsed_primitives.py", line 30, in
integer = pyparsing_common.signedInteger
AttributeError: type object 'pyparsing_common' has no attribute 'signedInteger'

[justinclift]

Interesting. It looks like an error happening in the DynamoDB connection library. Looking at that library on GitHub (https://github.com/stevearc/dql), it seems pretty much dead or close to it.

My first thought is we could just remove the DynamoDB library support for now, in order to get things working.

But it might actually be something else (simple) instead.

@gaecoli Would you have a few minutes to take a look at this?

[gaecoli]

Interesting. It looks like an error happening in the DynamoDB connection library. Looking at that library on GitHub (https://github.com/stevearc/dql), it seems pretty much dead or close to it.

My first thought is we could just remove the DynamoDB library support for now, in order to get things working.

But it might actually be something else (simple) instead.

@gaecoli Would you have a few minutes to take a look at this?

Tonight, i will look at this. I'm busy right now. Sorry.

[justinclift]

Tonight is completely fine, thank you. 😄

[gaecoli]

I have been trying to run the https://hub.docker.com/r/redashcommunity/redash/tags with docker. I have been following https://redash.io/help/open-source/dev-guide/docker for running the application on docker.

But, when I am running the command docker-compose run --rm server create_db, I am getting the following error:

Starting redash_redis_1 ... done Starting redash_postgres_1 ... done Traceback (most recent call last): File "/app/manage.py", line 6, in from redash.cli import manager File "/app/redash/init.py", line 56, in import_query_runners(settings.QUERY_RUNNERS) File "/app/redash/query_runner/init.py", line 445, in import_query_runners import(runner_import) File "/app/redash/query_runner/dynamodb_sql.py", line 10, in from dql import Engine, FragmentEngine File "/usr/local/lib/python3.7/site-packages/dql/init.py", line 6, in from .cli import DQLClient File "/usr/local/lib/python3.7/site-packages/dql/cli.py", line 21, in from .engine import FragmentEngine File "/usr/local/lib/python3.7/site-packages/dql/engine.py", line 47, in from .grammar import line_parser, parser File "/usr/local/lib/python3.7/site-packages/dql/grammar/init.py", line 37, in from .query import ( File "/usr/local/lib/python3.7/site-packages/dql/grammar/query.py", line 45, in from .parsed_primitives import primitive as parsed_primitive File "/usr/local/lib/python3.7/site-packages/dql/grammar/parsed_primitives.py", line 30, in integer = pyparsing_common.signedInteger AttributeError: type object 'pyparsing_common' has no attribute 'signedInteger'

Please show me how do you connect it.

[gaecoli]

Interesting. It looks like an error happening in the DynamoDB connection library. Looking at that library on GitHub (https://github.com/stevearc/dql), it seems pretty much dead or close to it.

My first thought is we could just remove the DynamoDB library support for now, in order to get things working.

But it might actually be something else (simple) instead.

@gaecoli Would you have a few minutes to take a look at this?

I think our docker image not build dql==0.6.2 in it. Thus causing the situation. @justinclift

[justinclift]

Oh. I wonder if our docker image build is not using the requirements_all_ds.txt during build then...

[gaecoli]

Oh. I wonder if our docker image build is not using the requirements_all_ds.txt during build then...

Yes, you understand me.