Importing 2GB of project fails. Rabbitmq message size is capped at 512MB

Troubleshooting
1

we’re moving one of our client’s project board into their self-hosted taiga machine. taiga installation using docker-compose is pretty straightforward using this link: (same step I did with our own)
https://docs.taiga.io/setup-production.html

The exported project size is more than 2GB and I already made some adjustments in the taiga nginx config:
increase nginx upload limit
increase timeout

image
image358×450 7.15 KB

After importing the project file, I’m not receiving any email notifications that the project is ready. looking into rabbitmq-async logs I see this error:
operation basic.publish caused a channel exception precondition_failed: message size 2155813815 is larger than configured max size 134217728

updating the rabbitmq max_message_size is not working since the max allowed value is only 512MB (536870912 bytes)
max_message_size invalid, Max message size should be between 0 and 512MB

is there another way to upload this project?

2

Hi there!

You should be able to import the project using the taiga-manage.sh script.

It should be ./taiga-manage.sh load_dump path_to_your_json_dump email_of_the_new_project_owner.

Please take into account that the owner must already exist on your Taiga instance.

Hope this helps,

Best regards!

2 Likes
3

hi there Charlie!

Thank you for replying in my concern. unfortunately I’m still encountering an error and its kinda confusing.

# ./taiga-manage.sh load_dump /path/to/my/project-export.json my-email@domain.com

[+] Creating 1/0
 ✔ Container taiga-docker-taiga-db-1  Running                                                                                                                                                                                                                             0.0s
Traceback (most recent call last):
  File "/taiga-back/manage.py", line 17, in <module>
    execute_from_command_line(sys.argv)
  File "/opt/venv/lib/python3.11/site-packages/django/core/management/__init__.py", line 419, in execute_from_command_line
    utility.execute()
  File "/opt/venv/lib/python3.11/site-packages/django/core/management/__init__.py", line 413, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/opt/venv/lib/python3.11/site-packages/django/core/management/base.py", line 354, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/opt/venv/lib/python3.11/site-packages/django/core/management/base.py", line 398, in execute
    output = self.handle(*args, **options)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/taiga-back/taiga/export_import/management/commands/load_dump.py", line 40, in handle
    data = json.loads(open(dump_file_path, 'r').read())
                      ^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/path/to/my/project-export.json'

I tried move my json file somewhere, and I even copied it to the DB container
docker cp /path/to/my/project-export.json taiga-docker-taiga-db-1:/project-export.json

still same error.

this is the content of my taiga-manage.sh script

#!/usr/bin/env sh

# This Source Code Form is subject to the terms of the Mozilla Public
# License, v. 2.0. If a copy of the MPL was not distributed with this
# file, You can obtain one at http://mozilla.org/MPL/2.0/.
#
# Copyright (c) 2021-present Kaleidos INC

set -x
exec docker-compose -f docker-compose.yml -f docker-compose-inits.yml run --rm taiga-manage $@

am I missing something here?

=========================================================
EDIT:

ok, I think I solved it. so what I did is I moved the json file inside the taiga-back container.

docker cp /path/to/my/project-export.json taiga-docker-taiga-back-1:/project-export.json

after that, I tried running the taiga-manage.sh script again, but it failed and got the same error

./taiga-manage.sh load_dump_load /project-export.json my-email@domain.com

...
...
...
FileNotFoundError: [Errno 2] No such file or directory: '/project-export.json'

so what I did next is I accessed the taiga-back container and ran the command there.

docker exec -ti taiga-docker-taiga-back-1 /bin/bash
python manage.py load_dump /project-export.json my-email@domain.com

it took some time and I still didn’t get any email (I think that’s expected?). but after checking the projects in the web dashboard, project was imported successfully.

1 Like
4

Hi there,

Glad to hear it worked!

Not getting the email is expected, since you are importing it manually from the CLI (and also because the action is synchronous).

Best regards!

1 Like