Skip to content

Large backups (over 2GB) fail on 32-bit home assistant #857

Closed
Closed
Large backups (over 2GB) fail on 32-bit home assistant#857
@ReNeGaDe124

Description

@ReNeGaDe124
ReNeGaDe124
opened on Jun 9, 2023

Add-on has stopped syncing backups to Google Drive with error "The Supervisor Returned an Unexpected Response"

I have tried to resync and to reboot my Raspberry like it was suggested but it still persists.

It was working fine until a few days ago. Nothing has changed previous to this error. I saw the problem was solved in the past (#226) but it seems to have reappeared. My OS is indeed 32bit.

Thank you! Best regards!

Description:
If you have anything else that could help explain what happened, click "Markdown" above and write it here.

Addon version: 0.110.4
Home Assistant Version: 2023.6.0
Supervisor Version: 2023.06.1
Supervisor Channel: stable
Hassos Version: None
Docker Version: 24.0.2
Architecture: armv7
Machine: raspberrypi4
Date: 2023-06-09T07:27:07.727421+00:00
Timezone: Europe/Bucharest
Failure Time: 2023-06-09T07:27:01.992123+00:00
Last Good Sync: 2023-06-09T07:27:01.159363+00:00
Next Sync: 2023-06-09T09:27:01.992123+00:00
Next Backup: 2023-06-09T21:00:00+00:00
Next Cache Warm: 2023-06-09T09:21:20.879077+00:00
Time Offset: 0.0

Exception:

 addon/backup/util/asynchttpgetter.py:203 (read)
 /site-packages/aiohttp/streams.py:437 (readexactly)
aiohttp.client_exceptions.ClientPayloadError: Response payload is not completed
Whose handling caused:
 addon/backup/model/coordinator.py:198 (_sync)
 addon/backup/model/model.py:246 (sync)
 addon/backup/drive/drivesource.py:202 (save)
 addon/backup/drive/driverequests.py:279 (create)
 addon/backup/util/asynchttpgetter.py:210 (read)
backup.exceptions.exceptions.SupervisorUnexpectedError

Backups:

{
   "HomeAssistant": {
       "backups": 3,
       "retained": 0,
       "deletable": 3,
       "name": "HomeAssistant",
       "title": "Home Assistant",
       "latest": "2023-06-08T22:30:04Z",
       "max": 3,
       "enabled": true,
       "icon": "home-assistant",
       "ignored": 3,
       "detail": "",
       "size": "8.4 GB",
       "ignored_size": "781.2 MB",
       "free_space": "360.2 GB"
   },
   "GoogleDrive": {
       "backups": 5,
       "retained": 0,
       "deletable": 5,
       "name": "GoogleDrive",
       "title": "Google Drive",
       "latest": "2023-06-06T21:00:00Z",
       "max": 7,
       "enabled": true,
       "icon": "google-drive",
       "ignored": 0,
       "detail": "renegade124@gmail.com",
       "size": "15.0 GB",
       "ignored_size": "0.0 B",
       "free_space": "31.1 GB"
   }
}
Config:
{
   "Setting.MAX_BACKUPS_IN_HA": 3,
   "Setting.MAX_BACKUPS_IN_GOOGLE_DRIVE": 7,
   "Setting.DAYS_BETWEEN_BACKUPS": 1.0,
   "Setting.BACKUP_NAME": "REDACTED",
   "Setting.BACKUP_TIME_OF_DAY": "00:00",
   "Setting.SPECIFY_BACKUP_FOLDER": true,
   "Setting.GENERATIONAL_WEEKS": 3,
   "Setting.GENERATIONAL_MONTHS": 1
}
Addon Logs:
06-09 08:50:46 DEBUG [backup.watcher] Checking backup source for changes...
06-09 09:52:16 INFO [backup.watcher] A backup directory file was modified, we'll check for new backups soon.
06-09 09:52:27 DEBUG [backup.watcher] Checking backup source for changes...
06-09 09:53:06 INFO [backup.watcher] A backup directory file was modified, we'll check for new backups soon.
06-09 09:53:17 DEBUG [backup.watcher] Checking backup source for changes...
06-09 09:53:17 DEBUG [backup.model.syncer] Sync requested by Backup Directory Watcher
06-09 09:53:17 INFO [backup.model.coordinator] Syncing Backups
06-09 09:53:17 DEBUG [backup.drive.driverequests] Requesting refreshed Google Drive credentials
06-09 09:53:18 INFO [backup.drive.drivesource] Uploading '09/06/2023_Home_Assistant_Backup_(2023.6.0)' to Google Drive
06-09 09:53:18 DEBUG [backup.drive.driverequests] Attempting to resume a previously failed upload where we left off
06-09 09:53:18 INFO [backup.watcher] A backup directory file was modified, we'll check for new backups soon.
06-09 09:53:18 DEBUG [backup.drive.driverequests] Resuming upload at byte 0 of 2500526080
06-09 09:53:18 ERROR [backup.model.coordinator] The supervisor gave an unexpected response
06-09 09:53:18 INFO [backup.model.coordinator] I'll try again in 2 hours
06-09 09:53:28 DEBUG [backup.watcher] Checking backup source for changes...
06-09 10:25:52 INFO [backup.model.coordinator] Syncing Backups
06-09 10:25:54 INFO [backup.watcher] A backup directory file was modified, we'll check for new backups soon.
06-09 10:25:54 INFO [backup.drive.drivesource] Uploading '09/06/2023_Home_Assistant_Backup_(2023.6.0)' to Google Drive
06-09 10:25:54 DEBUG [backup.drive.driverequests] Attempting to resume a previously failed upload where we left off
06-09 10:25:54 DEBUG [backup.drive.driverequests] Resuming upload at byte 0 of 2500526080
06-09 10:25:54 ERROR [backup.model.coordinator] The supervisor gave an unexpected response
06-09 10:25:54 INFO [backup.model.coordinator] I'll try again in 2 hours
06-09 10:26:04 DEBUG [backup.watcher] Checking backup source for changes...
06-09 10:27:01 INFO [backup.model.coordinator] Syncing Backups
06-09 10:27:01 INFO [backup.watcher] A backup directory file was modified, we'll check for new backups soon.
06-09 10:27:01 INFO [backup.drive.drivesource] Uploading '09/06/2023_Home_Assistant_Backup_(2023.6.0)' to Google Drive
06-09 10:27:01 DEBUG [backup.drive.driverequests] Attempting to resume a previously failed upload where we left off
06-09 10:27:01 DEBUG [backup.drive.driverequests] Resuming upload at byte 0 of 2500526080
06-09 10:27:01 ERROR [backup.model.coordinator] The supervisor gave an unexpected response
06-09 10:27:01 INFO [backup.model.coordinator] I'll try again in 2 hours
Supervisor Logs:
    resp, reset = await task
                 ^^^^^^^^^^
 File "/usr/local/lib/python3.11/site-packages/aiohttp/web_protocol.py", line 458, in _handle_request
   reset = await self.finish_response(request, resp, start_time)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 File "/usr/local/lib/python3.11/site-packages/aiohttp/web_protocol.py", line 611, in finish_response
   await prepare_meth(request)
 File "/usr/local/lib/python3.11/site-packages/aiohttp/web_fileresponse.py", line 286, in prepare
   return await self._sendfile(request, fobj, offset, count)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 File "/usr/local/lib/python3.11/site-packages/aiohttp/web_fileresponse.py", line 99, in _sendfile
   await loop.sendfile(transport, fobj, offset, count)
 File "/usr/local/lib/python3.11/asyncio/base_events.py", line 1185, in sendfile
   return await self._sendfile_native(transport, file,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 File "/usr/local/lib/python3.11/asyncio/selector_events.py", line 725, in _sendfile_native
   return await self.sock_sendfile(transp._sock, file, offset, count,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 File "/usr/local/lib/python3.11/asyncio/base_events.py", line 881, in sock_sendfile
   return await self._sock_sendfile_native(sock, file,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 File "/usr/local/lib/python3.11/asyncio/unix_events.py", line 373, in _sock_sendfile_native
   return await fut
          ^^^^^^^^^
 File "/usr/local/lib/python3.11/asyncio/unix_events.py", line 395, in _sock_sendfile_native_impl
   sent = os.sendfile(fd, fileno, offset, blocksize)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
OverflowError: Python int too large to convert to C ssize_t
�[32m23-06-09 10:27:07 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/logs access from cebe7a76_hassio_google_drive_backup�[0m
Home Assistant Core Logs:
    task.result()
 File "/usr/src/homeassistant/homeassistant/core.py", line 1950, in _execute_service
   await cast(Callable[[ServiceCall], Awaitable[None]], handler.job.target)(
 File "/usr/src/homeassistant/homeassistant/helpers/entity_component.py", line 226, in handle_service
   await service.entity_service_call(
 File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 811, in entity_service_call
   future.result()  # pop exception if have
   ^^^^^^^^^^^^^^^
 File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1034, in async_request_call
   await coro
 File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 851, in _handle_entity_call
   await result
 File "/usr/src/homeassistant/homeassistant/components/update/__init__.py", line 156, in async_install
   await entity.async_install_with_progress(version, backup)
 File "/usr/src/homeassistant/homeassistant/components/update/__init__.py", line 417, in async_install_with_progress
   await self.async_install(version, backup)
 File "/usr/src/homeassistant/homeassistant/components/hassio/update.py", line 169, in async_install
   raise HomeAssistantError(f"Error updating {self.title}: {err}") from err
homeassistant.exceptions.HomeAssistantError: Error updating AdGuard Home: Add-on a0d7b954_adguard is not available inside store�[0m
�[33m2023-06-09 10:26:25.066 WARNING (MainThread) [asyncio] socket.send() raised exception.�[0m
�[33m2023-06-09 10:26:29.507 WARNING (MainThread) [asyncio] socket.send() raised exception.�[0m
�[33m2023-06-09 10:26:30.671 WARNING (MainThread) [asyncio] socket.send() raised exception.�[0m
�[33m2023-06-09 10:26:40.079 WARNING (MainThread) [asyncio] socket.send() raised exception.�[0m
�[33m2023-06-09 10:26:44.512 WARNING (MainThread) [asyncio] socket.send() raised exception.�[0m
�[33m2023-06-09 10:26:45.679 WARNING (MainThread) [asyncio] socket.send() raised exception.�[0m
�[33m2023-06-09 10:26:52.493 WARNING (Thread-8) [pychromecast.socket_client] [Living Room TV(192.168.0.114):8009] Heartbeat timeout, resetting connection�[0m
�[33m2023-06-09 10:26:55.082 WARNING (MainThread) [asyncio] socket.send() raised exception.�[0m
�[33m2023-06-09 10:26:59.517 WARNING (MainThread) [asyncio] socket.send() raised exception.�[0m
�[33m2023-06-09 10:27:00.686 WARNING (MainThread) [asyncio] socket.send() raised exception.�[0m

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions