Skip to content

MaterializeMySQL run error #14894

@little-tomato

Description

@little-tomato

I have created MaterializeMySQL with:
CREATE DATABASE dmp_idm ENGINE = MaterializeMySQL('xxx:3307', 'dmp_idm', 'root', 'xxx');

my.cnf:
gtid_mode=on
enforce_gtid_consistency=true
binlog_format=ROW
log-bin=mysql-bin

see the log:
tail -100f clickhouse-server.err.log
2020.09.17 10:37:30.979768 [ 13674 ] {} BaseDaemon: ########################################
2020.09.17 10:37:30.979849 [ 13674 ] {} BaseDaemon: (version 20.9.1.4571 (official build), no build id) (from thread 13578) (no query) Received signal Segmentation fault (11)
2020.09.17 10:37:30.979889 [ 13674 ] {} BaseDaemon: Address: 0x2d85ef80 Access: write. Address not mapped to object.
2020.09.17 10:37:30.979914 [ 13674 ] {} BaseDaemon: Stack trace: 0x15c225a8 0x15c188f8 0x15c1bf25 0x15889272 0x15bf6aa2 0x15bf8402 0x157e7064 0x157f10d5 0x157f2803 0x1582ccb9 0x1582f0ee 0x157eaa91 0x157ef71b 0x157efc36 0xe641547 0xe63fb83 0x7fd0189fcdc5 0x7fd01831e21d
2020.09.17 10:37:30.980005 [ 13674 ] {} BaseDaemon: 3. std::__1::enable_if<(std::__1::__is_cpp17_forward_iterator<std::__1::__wrap_iter<std::__1::shared_ptrDB::IAST> >::value) && (std::__1::is_constructible<std::__1::shared_ptrDB::IAST, std::__1::iterator_traitsstd::__1::iterator_traits::reference>::value), std::__1::__wrap_iter<std::__1::shared_ptrDB::IAST> >::type std::__1::vector<std::__1::shared_ptrDB::IAST, std::__1::allocator<std::__1::shared_ptrDB::IAST > >::insert<std::__1::__wrap_iter<std::__1::shared_ptrDB::IAST> >(std::__1::__wrap_iter<std::__1::shared_ptrDB::IAST const>, std::__1::iterator_traits, std::__1::iterator_traits) @ 0x15c225a8 in /usr/bin/clickhouse
2020.09.17 10:37:30.980034 [ 13674 ] {} BaseDaemon: 4. ? @ 0x15c188f8 in /usr/bin/clickhouse
2020.09.17 10:37:30.980056 [ 13674 ] {} BaseDaemon: 5. DB::MySQLInterpreter::InterpreterCreateImpl::getRewrittenQueries(DB::MySQLParser::ASTCreateQuery const&, DB::Context const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x15c1bf25 in /usr/bin/clickhouse
2020.09.17 10:37:30.980081 [ 13674 ] {} BaseDaemon: 6. DB::InterpreterExternalDDLQuery::execute() @ 0x15889272 in /usr/bin/clickhouse
2020.09.17 10:37:30.980095 [ 13674 ] {} BaseDaemon: 7. ? @ 0x15bf6aa2 in /usr/bin/clickhouse
2020.09.17 10:37:30.980113 [ 13674 ] {} BaseDaemon: 8. DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) @ 0x15bf8402 in /usr/bin/clickhouse
2020.09.17 10:37:30.980126 [ 13674 ] {} BaseDaemon: 9. ? @ 0x157e7064 in /usr/bin/clickhouse
2020.09.17 10:37:30.980138 [ 13674 ] {} BaseDaemon: 10. ? @ 0x157f10d5 in /usr/bin/clickhouse
2020.09.17 10:37:30.980149 [ 13674 ] {} BaseDaemon: 11. ? @ 0x157f2803 in /usr/bin/clickhouse
2020.09.17 10:37:30.980174 [ 13674 ] {} BaseDaemon: 12. DB::commitMetadata(std::__1::function<void ()> const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x1582ccb9 in /usr/bin/clickhouse
2020.09.17 10:37:30.980195 [ 13674 ] {} BaseDaemon: 13. DB::MaterializeMetadata::transaction(DB::MySQLReplication::Position const&, std::__1::function<void ()> const&) @ 0x1582f0ee in /usr/bin/clickhouse
2020.09.17 10:37:30.980226 [ 13674 ] {} BaseDaemon: 14. DB::MaterializeMySQLSyncThread::prepareSynchronized(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157eaa91 in /usr/bin/clickhouse
2020.09.17 10:37:30.980249 [ 13674 ] {} BaseDaemon: 15. DB::MaterializeMySQLSyncThread::synchronization(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157ef71b in /usr/bin/clickhouse
2020.09.17 10:37:30.980261 [ 13674 ] {} BaseDaemon: 16. ? @ 0x157efc36 in /usr/bin/clickhouse
2020.09.17 10:37:30.980279 [ 13674 ] {} BaseDaemon: 17. ThreadPoolImplstd::__1::thread::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe641547 in /usr/bin/clickhouse
2020.09.17 10:37:30.980291 [ 13674 ] {} BaseDaemon: 18. ? @ 0xe63fb83 in /usr/bin/clickhouse
2020.09.17 10:37:30.980329 [ 13674 ] {} BaseDaemon: 19. start_thread @ 0x7dc5 in /usr/lib64/libpthread-2.17.so
2020.09.17 10:37:30.980349 [ 13674 ] {} BaseDaemon: 20. clone @ 0xf621d in /usr/lib64/libc-2.17.so
2020.09.17 10:38:11.697416 [ 13738 ] {} MaterializeMySQLSyncThread: Code: 76, e.displayText() = DB::ErrnoException: Cannot open file /data/clickhouse/metadata/dmp_idm//.metadata.tmp, errno: 17, strerror: File exists, Stack trace (when copying this message, always include the lines below):

  1. Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int) @ 0x18bcb170 in /usr/bin/clickhouse

  2. DB::ErrnoException::ErrnoException(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int, std::__1::optional<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > const&) @ 0xe617f8b in /usr/bin/clickhouse

  3. DB::throwFromErrnoWithPath(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int) @ 0xe615d8a in /usr/bin/clickhouse

  4. DB::WriteBufferFromFile::WriteBufferFromFile(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned long, int, unsigned int, char*, unsigned long) @ 0xe71f608 in /usr/bin/clickhouse

  5. DB::MaterializeMetadata::transaction(DB::MySQLReplication::Position const&, std::__1::function<void ()> const&) @ 0x1582e78c in /usr/bin/clickhouse

  6. DB::MaterializeMySQLSyncThread::prepareSynchronized(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157eaa91 in /usr/bin/clickhouse

  7. DB::MaterializeMySQLSyncThread::synchronization(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157ef71b in /usr/bin/clickhouse

  8. ? @ 0x157efc36 in /usr/bin/clickhouse

  9. ThreadPoolImplstd::__1::thread::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe641547 in /usr/bin/clickhouse

  10. ? @ 0xe63fb83 in /usr/bin/clickhouse

  11. start_thread @ 0x7dc5 in /usr/lib64/libpthread-2.17.so

  12. clone @ 0xf621d in /usr/lib64/libc-2.17.so
    (version 20.9.1.4571 (official build))
    2020.09.17 10:38:11.698228 [ 13738 ] {} MaterializeMySQLSyncThread: Code: 76, e.displayText() = DB::ErrnoException: Cannot open file /data/clickhouse/metadata/dmp_idm//.metadata.tmp, errno: 17, strerror: File exists, Stack trace (when copying this message, always include the lines below):

  13. Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int) @ 0x18bcb170 in /usr/bin/clickhouse

  14. DB::ErrnoException::ErrnoException(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int, std::__1::optional<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > const&) @ 0xe617f8b in /usr/bin/clickhouse

  15. DB::throwFromErrnoWithPath(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int) @ 0xe615d8a in /usr/bin/clickhouse

  16. DB::WriteBufferFromFile::WriteBufferFromFile(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned long, int, unsigned int, char*, unsigned long) @ 0xe71f608 in /usr/bin/clickhouse

  17. DB::MaterializeMetadata::transaction(DB::MySQLReplication::Position const&, std::__1::function<void ()> const&) @ 0x1582e78c in /usr/bin/clickhouse

  18. DB::MaterializeMySQLSyncThread::prepareSynchronized(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157eaa91 in /usr/bin/clickhouse

  19. DB::MaterializeMySQLSyncThread::synchronization(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157ef71b in /usr/bin/clickhouse

  20. ? @ 0x157efc36 in /usr/bin/clickhouse

  21. ThreadPoolImplstd::__1::thread::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe641547 in /usr/bin/clickhouse

  22. ? @ 0xe63fb83 in /usr/bin/clickhouse

  23. start_thread @ 0x7dc5 in /usr/lib64/libpthread-2.17.so

  24. clone @ 0xf621d in /usr/lib64/libc-2.17.so
    (version 20.9.1.4571 (official build))
    2020.09.17 10:38:26.307285 [ 13793 ] {fc34c804-2465-413b-97f6-cb7aca0526c8} executeQuery: Code: 76, e.displayText() = DB::Exception: Cannot open file /data/clickhouse/metadata/dmp_idm//.metadata.tmp, errno: 17, strerror: File exists (version 20.9.1.4571 (official build)) (from 172.30.108.6:51390) (in query: SELECT * FROM dmp_idm.invitation FORMAT TabSeparatedWithNamesAndTypes;), Stack trace (when copying this message, always include the lines below):

  25. Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int) @ 0x18bcb170 in /usr/bin/clickhouse

  26. DB::ErrnoException::ErrnoException(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int, std::__1::optional<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > const&) @ 0xe617f8b in /usr/bin/clickhouse

  27. DB::throwFromErrnoWithPath(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int) @ 0xe615d8a in /usr/bin/clickhouse

  28. DB::WriteBufferFromFile::WriteBufferFromFile(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned long, int, unsigned int, char*, unsigned long) @ 0xe71f608 in /usr/bin/clickhouse

  29. DB::MaterializeMetadata::transaction(DB::MySQLReplication::Position const&, std::__1::function<void ()> const&) @ 0x1582e78c in /usr/bin/clickhouse

  30. DB::MaterializeMySQLSyncThread::prepareSynchronized(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157eaa91 in /usr/bin/clickhouse

  31. DB::MaterializeMySQLSyncThread::synchronization(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157ef71b in /usr/bin/clickhouse

  32. ? @ 0x157efc36 in /usr/bin/clickhouse

  33. ThreadPoolImplstd::__1::thread::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe641547 in /usr/bin/clickhouse

  34. ? @ 0xe63fb83 in /usr/bin/clickhouse

  35. start_thread @ 0x7dc5 in /usr/lib64/libpthread-2.17.so

  36. clone @ 0xf621d in /usr/lib64/libc-2.17.so

2020.09.17 10:38:26.307798 [ 13793 ] {fc34c804-2465-413b-97f6-cb7aca0526c8} DynamicQueryHandler: Code: 76, e.displayText() = DB::Exception: Cannot open file /data/clickhouse/metadata/dmp_idm//.metadata.tmp, errno: 17, strerror: File exists, Stack trace (when copying this message, always include the lines below):

  1. Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int) @ 0x18bcb170 in /usr/bin/clickhouse
  2. DB::ErrnoException::ErrnoException(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int, std::__1::optional<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > const&) @ 0xe617f8b in /usr/bin/clickhouse
  3. DB::throwFromErrnoWithPath(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int) @ 0xe615d8a in /usr/bin/clickhouse
  4. DB::WriteBufferFromFile::WriteBufferFromFile(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned long, int, unsigned int, char*, unsigned long) @ 0xe71f608 in /usr/bin/clickhouse
  5. DB::MaterializeMetadata::transaction(DB::MySQLReplication::Position const&, std::__1::function<void ()> const&) @ 0x1582e78c in /usr/bin/clickhouse
  6. DB::MaterializeMySQLSyncThread::prepareSynchronized(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157eaa91 in /usr/bin/clickhouse
  7. DB::MaterializeMySQLSyncThread::synchronization(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157ef71b in /usr/bin/clickhouse
  8. ? @ 0x157efc36 in /usr/bin/clickhouse
  9. ThreadPoolImplstd::__1::thread::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe641547 in /usr/bin/clickhouse
  10. ? @ 0xe63fb83 in /usr/bin/clickhouse
  11. start_thread @ 0x7dc5 in /usr/lib64/libpthread-2.17.so
  12. clone @ 0xf621d in /usr/lib64/libc-2.17.so
    (version 20.9.1.4571 (official build))

help me,please!

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions