Skip to content

[FLASH-469/452/462] DM: Rename column, read with specify tso, schema-version#234

Merged
JaySon-Huang merged 9 commits intopingcap:DeltaMergeEnginefrom
JaySon-Huang:dm-raft-integrate
Sep 18, 2019
Merged

[FLASH-469/452/462] DM: Rename column, read with specify tso, schema-version#234
JaySon-Huang merged 9 commits intopingcap:DeltaMergeEnginefrom
JaySon-Huang:dm-raft-integrate

Conversation

@JaySon-Huang
Copy link
Contributor

@JaySon-Huang JaySon-Huang commented Sep 16, 2019

  • Support rename column in DeltaMerge tables
  • Read with specify tso / schema version by override client settings
  • Add some tests for MVCC filter
  • IManageableStorage::check to IManageableStorage::checkStatus, because it hide the function of ITableDeclaration::check
  • Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime

@JaySon-Huang
Copy link
Contributor Author

/run-integration-tests

@JaySon-Huang
Copy link
Contributor Author

/run-integration-tests

@JaySon-Huang
Copy link
Contributor Author

/run-integration-tests

@JaySon-Huang
Copy link
Contributor Author

Caused by: java.io.IOException: Read schema failed, reason: Exception read from CH server (127.0.0.1:9000)Code: 50. DB::Exception. DB::Exception: Unknown data type family: MyDate, Stack trace:

We need to rebase branch DeltaMergeEngine to master..

2. Support rename column && identify column by id in DeltaMerge DDL
…ent version is old)

Note that we still not support time travel read now
2. Support read with specify tso
3. Add test cases for read with specify tso through raft
@JaySon-Huang
Copy link
Contributor Author

/run-integration-tests

@JaySon-Huang
Copy link
Contributor Author

JaySon-Huang commented Sep 18, 2019

Exception thrown when running delta-merge-test/ddl/alter_default_value.test.
https://github.com/pingcap/tics/blob/2633845a21/dbms/src/Storages/DeltaMerge/Index/MinMax.h#L148
In this file, we try to cast ColumnDateTime(which is ColumnUInt32 in actual) to ColumnInt64 and get nullptr back.

DataTypeDate(DataTypeUInt16 in actual), DataTypeDateTime(DataTypeUInt32 in actual), but we generate wrong type of MinMaxIndex in these lines.

https://github.com/pingcap/tics/blob/2633845a21/dbms/src/Storages/DeltaMerge/Index/MinMaxIndex.cpp#L43-L46

Fixed those lines to use typename DataTypeDate::FieldType instead of specific type.

@flowbehappy

@JaySon-Huang
Copy link
Contributor Author

/build

@JaySon-Huang
Copy link
Contributor Author

/run-integration-tests

}
else if (command.type == AlterCommand::RENAME_COLUMN)
{
for (auto && c : table_columns)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for ()
{
multiple lines
}

@flowbehappy
Copy link
Contributor

LGTM

@JaySon-Huang JaySon-Huang merged commit e02dc58 into pingcap:DeltaMergeEngine Sep 18, 2019
JaySon-Huang added a commit to JaySon-Huang/tiflash that referenced this pull request Sep 23, 2019
…version (pingcap#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
JaySon-Huang added a commit to JaySon-Huang/tiflash that referenced this pull request Sep 23, 2019
…version (pingcap#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
JaySon-Huang added a commit that referenced this pull request Sep 26, 2019
…version (#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
JaySon-Huang added a commit to JaySon-Huang/tiflash that referenced this pull request Oct 17, 2019
…version (pingcap#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
JaySon-Huang added a commit to JaySon-Huang/tiflash that referenced this pull request Oct 18, 2019
…version (pingcap#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
JaySon-Huang added a commit that referenced this pull request Oct 22, 2019
…version (#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
JaySon-Huang added a commit to JaySon-Huang/tiflash that referenced this pull request Oct 23, 2019
…version (pingcap#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
JaySon-Huang added a commit to JaySon-Huang/tiflash that referenced this pull request Oct 30, 2019
…version (pingcap#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
JaySon-Huang added a commit to JaySon-Huang/tiflash that referenced this pull request Nov 1, 2019
…version (pingcap#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
JaySon-Huang added a commit to JaySon-Huang/tiflash that referenced this pull request Nov 1, 2019
…version (pingcap#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
JaySon-Huang added a commit to JaySon-Huang/tiflash that referenced this pull request Nov 5, 2019
…version (pingcap#234)

* Support rename column in DeltaMerge tables
* Read with specify tso / schema version by override client settings
* Add some tests for MVCC filter
* `IManageableStorage::check` to `IManageableStorage::checkStatus`, because it hide the function of `ITableDeclaration::check`
* Fix bug in MinMaxIndex of DataTypeDate and DataTypeDateTime
@JaySon-Huang JaySon-Huang deleted the dm-raft-integrate branch September 27, 2020 09:21
JaySon-Huang pushed a commit to JaySon-Huang/tiflash that referenced this pull request Aug 2, 2024
Signed-off-by: Wish <breezewish@outlook.com>
JaySon-Huang pushed a commit that referenced this pull request Aug 6, 2024
Signed-off-by: Wish <breezewish@outlook.com>
Lloyd-Pottiger pushed a commit to Lloyd-Pottiger/tiflash that referenced this pull request Sep 20, 2024
Signed-off-by: Wish <breezewish@outlook.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants