Project

General

Profile

Bug #1666

Updated by bill-auger about 6 years ago

the parabolaweb website has not updated in almost a month

it looks like all of the services are running normally on proton - the 'parabolaweb-reporead-rsync' systemd cron job syncs the repo with rsync without error every hour but throws many parsing errors of various types from the python script /srv/http/www.parabola.nu/web/devel/management/commands/reporead.py - these could be the source of the problem

<pre>
$ cp /usr/bin/parabolaweb-reporead-rsync ~
$ ~/parabolaweb-reporead-rsync
</pre>

there are general classes or error noted below - the entire console output is attached

<pre>
--------------------------------------------------------------------------------

2018-03-18 22:04:57 -> INFO: adding 21 files for package python2-jsonlines
Traceback (most recent call last):
File "/srv/http/www.parabola.nu/web/manage.py", line 10, in <module>
execute_from_command_line(sys.argv)
File "/usr/lib/python2.7/site-packages/django/core/management/__init__.py", line 385, in execute_from_command_line
utility.execute()
File "/usr/lib/python2.7/site-packages/django/core/management/__init__.py", line 377, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/usr/lib/python2.7/site-packages/django/core/management/base.py", line 288, in run_from_argv
self.execute(*args, **options.__dict__)
File "/usr/lib/python2.7/site-packages/django/core/management/base.py", line 338, in execute
output = self.handle(*args, **options)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 76, in handle
return read_repo(arch, filename, options)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 600, in read_repo
db_update(arch, repo, packages_arches[arch], force)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 402, in db_update
populate_pkg(dbpkg, pkg, timestamp=timestamp)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 238, in populate_pkg
populate_files(dbpkg, repopkg, force=force)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 329, in populate_files
batched_bulk_create(PackageFile, pkg_files)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 278, in batched_bulk_create
return model.objects.bulk_create(all_objects)
File "/usr/lib/python2.7/site-packages/django/db/models/manager.py", line 92, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/django/db/models/query.py", line 409, in bulk_create
self._batched_insert(objs_without_pk, fields, batch_size)
File "/usr/lib/python2.7/site-packages/django/db/models/query.py", line 938, in _batched_insert
using=self.db)
File "/usr/lib/python2.7/site-packages/django/db/models/manager.py", line 92, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/django/db/models/query.py", line 921, in _insert
return query.get_compiler(using=using).execute_sql(return_id)
File "/usr/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 921, in execute_sql
cursor.execute(sql, params)
File "/usr/lib/python2.7/site-packages/django/db/backends/utils.py", line 81, in execute
return super(CursorDebugWrapper, self).execute(sql, params)
File "/usr/lib/python2.7/site-packages/django/db/backends/utils.py", line 65, in execute
return self.cursor.execute(sql, params)
File "/usr/lib/python2.7/site-packages/django/db/utils.py", line 94, in __exit__
six.reraise(dj_exc_type, dj_exc_value, traceback)
File "/usr/lib/python2.7/site-packages/django/db/backends/utils.py", line 65, in execute
return self.cursor.execute(sql, params)
django.db.utils.DataError: integer out of range

--------------------------------------------------------------------------------

2018-03-18 22:05:45 -> INFO: Updating ~fauno (any)
Traceback (most recent call last):
File "/srv/http/www.parabola.nu/web/manage.py", line 10, in <module>
execute_from_command_line(sys.argv)
File "/usr/lib/python2.7/site-packages/django/core/management/__init__.py", line 385, in execute_from_command_line
utility.execute()
File "/usr/lib/python2.7/site-packages/django/core/management/__init__.py", line 377, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/usr/lib/python2.7/site-packages/django/core/management/base.py", line 288, in run_from_argv
self.execute(*args, **options.__dict__)
File "/usr/lib/python2.7/site-packages/django/core/management/base.py", line 338, in execute
output = self.handle(*args, **options)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 76, in handle
return read_repo(arch, filename, options)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 600, in read_repo
db_update(arch, repo, packages_arches[arch], force)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 380, in db_update
dbpkgs = update_common(archname, reponame, pkgs, True)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 342, in update_common
repository = Repo.objects.get(name__iexact=reponame)
File "/usr/lib/python2.7/site-packages/django/db/models/manager.py", line 92, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/django/db/models/query.py", line 357, in get
self.model._meta.object_name)
main.models.DoesNotExist: Repo matching query does not exist.

--------------------------------------------------------------------------------

2018-03-18 22:05:46 -> INFO: Adding package firestarter
Traceback (most recent call last):
File "/srv/http/www.parabola.nu/web/manage.py", line 10, in <module>
execute_from_command_line(sys.argv)
File "/usr/lib/python2.7/site-packages/django/core/management/__init__.py", line 385, in execute_from_command_line
utility.execute()
File "/usr/lib/python2.7/site-packages/django/core/management/__init__.py", line 377, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/usr/lib/python2.7/site-packages/django/core/management/base.py", line 288, in run_from_argv
self.execute(*args, **options.__dict__)
File "/usr/lib/python2.7/site-packages/django/core/management/base.py", line 338, in execute
output = self.handle(*args, **options)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 76, in handle
return read_repo(arch, filename, options)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 600, in read_repo
db_update(arch, repo, packages_arches[arch], force)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 402, in db_update
populate_pkg(dbpkg, pkg, timestamp=timestamp)
File "/srv/http/www.parabola.nu/web/devel/management/commands/reporead.py", line 232, in populate_pkg
dbpkg.signature_bytes = b64decode(repopkg.pgpsig.encode('utf-8'))
AttributeError: 'NoneType' object has no attribute 'encode'

--------------------------------------------------------------------------------
</pre>

Back