Skip to content

sentry: conn_executor.go:830: runtime error: index out of range [0] with length 0 (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1 | github.... #95008

Closed
#95009
Closed
sentry: conn_executor.go:830: runtime error: index out of range [0] with length 0 (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1 | github....#95008
#95009
Assignees
rafiss
Labels
C-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.O-sentryOriginated from an in-the-wild panic report.
@cockroach-teamcity

Description

@cockroach-teamcity
cockroach-teamcity
opened on Jan 10, 2023

This issue was autofiled by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry link: https://sentry.io/organizations/cockroach-labs/issues/3866472325/?referrer=webhooks_plugin

Panic message:

conn_executor.go:830: runtime error: index out of range [0] with length 0
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:830
| [...repeated from below...]
Wraps: (2) while executing: SELECT z()
Wraps: (3) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:830
| runtime.gopanic
| GOROOT/src/runtime/panic.go:884
| runtime.goPanicIndex
| GOROOT/src/runtime/panic.go:113
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*DTuple).pgwireFormat
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree/pgwire_encode.go:52
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*DTuple).Format
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree/datum.go:4040
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*FmtCtx).formatNodeOrHideConstants
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree/hide_constants.go:49
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*FmtCtx).FormatNode
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree/format.go:452
| github.com/cockroachdb/cockroach/pkg/sql/pgwire.writeTextDatumNotNull
| github.com/cockroachdb/cockroach/pkg/sql/pgwire/types.go:244
| github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*writeBuffer).writeTextColumnarElement
| github.com/cockroachdb/cockroach/pkg/sql/pgwire/types.go:352
| github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).bufferBatch
| github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:1391
| github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*commandResult).AddBatch
| github.com/cockroachdb/cockroach/pkg/sql/pgwire/command_result.go:230
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLReceiver).PushBatch
| github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1369
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run
| github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:311
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*vectorizedFlow).Run
| github.com/cockroachdb/cockroach/pkg/sql/colflow/vectorized_flow.go:320
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).Run
| github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:731
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun
| github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1698
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll
| github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1421
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1579
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1193
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:689
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt.func1
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:131
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:2420
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:130
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd.func1
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1932
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1936
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1858
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:832
| github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommandsAsync.func1
| github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:728
| runtime.goexit
| src/runtime/asm_amd64.s:1594
Wraps: (4) runtime error: index out of range [0] with length 0
Error types: (1) *withstack.withStack (2) *safedetails.withSafeDetails (3) *withstack.withStack (4) runtime.boundsError
-- report composition:
runtime.boundsError
conn_executor.go:830: *withstack.withStack (top exception)
*safedetails.withSafeDetails: while executing: SELECT z()
conn_executor.go:830: *withstack.withStack (1)
(check the extra data payloads)

Stacktrace (expand for inline code snippets):

cockroach/pkg/sql/conn_executor.go

Lines 829 to 831 in 07a53a3

r := recover()
h.ex.closeWrapper(ctx, r)
}(ctx, h)
in pkg/sql.(*Server).ServeConn.func1
GOROOT/src/runtime/panic.go#L883-L885 in runtime.gopanic
GOROOT/src/runtime/panic.go#L112-L114 in runtime.goPanicIndex

cockroach/pkg/sql/sem/tree/pgwire_encode.go

Lines 51 to 53 in 07a53a3

ctx.WriteString(comma)
t := d.ResolvedType().TupleContents()[i]
switch dv := UnwrapDOidWrapper(v).(type) {
in pkg/sql/sem/tree.(*DTuple).pgwireFormat

cockroach/pkg/sql/sem/tree/datum.go

Lines 4039 to 4041 in 07a53a3

if ctx.HasFlags(fmtPgwireFormat) {
d.pgwireFormat(ctx)
return
in pkg/sql/sem/tree.(*DTuple).Format

cockroach/pkg/sql/sem/tree/hide_constants.go

Lines 48 to 50 in 07a53a3

}
n.Format(ctx)
}
in pkg/sql/sem/tree.(*FmtCtx).formatNodeOrHideConstants

cockroach/pkg/sql/sem/tree/format.go

Lines 451 to 453 in 07a53a3

} else {
ctx.formatNodeOrHideConstants(n)
}
in pkg/sql/sem/tree.(*FmtCtx).FormatNode

cockroach/pkg/sql/pgwire/types.go

Lines 243 to 245 in 07a53a3

case *tree.DTuple:
b.textFormatter.FormatNode(v)
b.writeFromFmtCtx(b.textFormatter)
in pkg/sql/pgwire.writeTextDatumNotNull

cockroach/pkg/sql/pgwire/types.go

Lines 351 to 353 in 07a53a3

// All other types are represented via the datum-backed vector.
writeTextDatumNotNull(b, vecs.DatumCols[colIdx].Get(rowIdx).(tree.Datum), conv, sessionLoc, typ)
}
in pkg/sql/pgwire.(*writeBuffer).writeTextColumnarElement

cockroach/pkg/sql/pgwire/conn.go

Lines 1390 to 1392 in 07a53a3

case pgwirebase.FormatText:
c.msgBuilder.writeTextColumnarElement(ctx, &c.vecsScratch, vecIdx, rowIdx, r.conv, r.location)
case pgwirebase.FormatBinary:
in pkg/sql/pgwire.(*conn).bufferBatch

cockroach/pkg/sql/pgwire/command_result.go

Lines 229 to 231 in 07a53a3

r.rowsAffected += batch.Length()
return r.conn.bufferBatch(ctx, batch, r)
}
in pkg/sql/pgwire.(*commandResult).AddBatch

cockroach/pkg/sql/distsql_running.go

Lines 1368 to 1370 in 07a53a3

r.tracing.TraceExecBatchResult(r.ctx, batch)
if commErr := r.batchWriter.AddBatch(r.ctx, batch); commErr != nil {
r.handleCommErr(commErr)
in pkg/sql.(*DistSQLReceiver).PushBatch

cockroach/pkg/sql/colflow/flow_coordinator.go

Lines 310 to 312 in 07a53a3

}
switch status = f.output.PushBatch(f.batch, nil /* meta */); status {
case execinfra.ConsumerClosed:
in pkg/sql/colflow.(*BatchFlowCoordinator).Run

cockroach/pkg/sql/colflow/vectorized_flow.go

Lines 319 to 321 in 07a53a3

log.VEvent(ctx, 1, "running the batch flow coordinator in the flow's goroutine")
f.batchFlowCoordinator.Run(ctx)
}
in pkg/sql/colflow.(*vectorizedFlow).Run

cockroach/pkg/sql/distsql_running.go

Lines 730 to 732 in 07a53a3

// TODO(radu): this should go through the flow scheduler.
flow.Run(ctx, func() {})
in pkg/sql.(*DistSQLPlanner).Run

cockroach/pkg/sql/distsql_running.go

Lines 1697 to 1699 in 07a53a3

recv.expectedRowsRead = int64(physPlan.TotalEstimatedScannedRows)
runCleanup := dsp.Run(ctx, planCtx, txn, physPlan, recv, evalCtx, nil /* finishedSetupFn */)
return func() {
in pkg/sql.(*DistSQLPlanner).PlanAndRun

cockroach/pkg/sql/distsql_running.go

Lines 1420 to 1422 in 07a53a3

// the planner whether or not to plan remote table readers.
cleanup := dsp.PlanAndRun(
ctx, evalCtx, planCtx, planner.txn, planner.curPlan.main, recv,
in pkg/sql.(*DistSQLPlanner).PlanAndRunAll

cockroach/pkg/sql/conn_executor_exec.go

Lines 1578 to 1580 in 07a53a3

}
err := ex.server.cfg.DistSQLPlanner.PlanAndRunAll(ctx, evalCtx, planCtx, planner, recv, evalCtxFactory)
return *recv.stats, err
in pkg/sql.(*connExecutor).execWithDistSQLEngine

cockroach/pkg/sql/conn_executor_exec.go

Lines 1192 to 1194 in 07a53a3

ex.sessionTracing.TraceExecStart(ctx, "distributed")
stats, err = ex.execWithDistSQLEngine(
ctx, planner, stmt.AST.StatementReturnType(), res, distribute, progAtomic,
in pkg/sql.(*connExecutor).dispatchToExecutionEngine

cockroach/pkg/sql/conn_executor_exec.go

Lines 688 to 690 in 07a53a3

if err := ex.dispatchToExecutionEngine(stmtCtx, p, res); err != nil {
stmtThresholdSpan.Finish()
in pkg/sql.(*connExecutor).execStmtInOpenState

cockroach/pkg/sql/conn_executor_exec.go

Lines 130 to 132 in 07a53a3

err = ex.execWithProfiling(ctx, ast, prepared, func(ctx context.Context) error {
ev, payload, err = ex.execStmtInOpenState(ctx, parserStmt, prepared, pinfo, res, canAutoCommit)
return err
in pkg/sql.(*connExecutor).execStmt.func1

cockroach/pkg/sql/conn_executor_exec.go

Lines 2419 to 2421 in 07a53a3

} else {
err = op(ctx)
}
in pkg/sql.(*connExecutor).execWithProfiling

cockroach/pkg/sql/conn_executor_exec.go

Lines 129 to 131 in 07a53a3

case stateOpen:
err = ex.execWithProfiling(ctx, ast, prepared, func(ctx context.Context) error {
ev, payload, err = ex.execStmtInOpenState(ctx, parserStmt, prepared, pinfo, res, canAutoCommit)
in pkg/sql.(*connExecutor).execStmt

cockroach/pkg/sql/conn_executor.go

Lines 1931 to 1933 in 07a53a3

canAutoCommit := ex.implicitTxn() && (tcmd.LastInBatch || !implicitTxnForBatch)
ev, payload, err = ex.execStmt(
ctx, tcmd.Statement, nil /* prepared */, nil /* pinfo */, stmtRes, canAutoCommit,
in pkg/sql.(*connExecutor).execCmd.func1

cockroach/pkg/sql/conn_executor.go

Lines 1935 to 1937 in 07a53a3

return err
}()
// Note: we write to ex.statsCollector.PhaseTimes, instead of ex.phaseTimes,
in pkg/sql.(*connExecutor).execCmd

cockroach/pkg/sql/conn_executor.go

Lines 1857 to 1859 in 07a53a3

var err error
if err = ex.execCmd(); err != nil {
if errors.IsAny(err, io.EOF, errDrainingComplete) {
in pkg/sql.(*connExecutor).run

cockroach/pkg/sql/conn_executor.go

Lines 831 to 833 in 07a53a3

}(ctx, h)
return h.ex.run(ctx, s.pool, reserved, cancel)
}
in pkg/sql.(*Server).ServeConn

cockroach/pkg/sql/pgwire/conn.go

Lines 727 to 729 in 07a53a3

reservedOwned = false // We're about to pass ownership away.
retErr = sqlServer.ServeConn(ctx, connHandler, reserved, cancelConn)
}()
in pkg/sql/pgwire.(*conn).processCommandsAsync.func1
src/runtime/asm_amd64.s#L1593-L1595 in runtime.goexit

pkg/sql/conn_executor.go in pkg/sql.(*Server).ServeConn.func1 at line 830
GOROOT/src/runtime/panic.go in runtime.gopanic at line 884
GOROOT/src/runtime/panic.go in runtime.goPanicIndex at line 113
pkg/sql/sem/tree/pgwire_encode.go in pkg/sql/sem/tree.(*DTuple).pgwireFormat at line 52
pkg/sql/sem/tree/datum.go in pkg/sql/sem/tree.(*DTuple).Format at line 4040
pkg/sql/sem/tree/hide_constants.go in pkg/sql/sem/tree.(*FmtCtx).formatNodeOrHideConstants at line 49
pkg/sql/sem/tree/format.go in pkg/sql/sem/tree.(*FmtCtx).FormatNode at line 452
pkg/sql/pgwire/types.go in pkg/sql/pgwire.writeTextDatumNotNull at line 244
pkg/sql/pgwire/types.go in pkg/sql/pgwire.(*writeBuffer).writeTextColumnarElement at line 352
pkg/sql/pgwire/conn.go in pkg/sql/pgwire.(*conn).bufferBatch at line 1391
pkg/sql/pgwire/command_result.go in pkg/sql/pgwire.(*commandResult).AddBatch at line 230
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLReceiver).PushBatch at line 1369
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).Run at line 311
pkg/sql/colflow/vectorized_flow.go in pkg/sql/colflow.(*vectorizedFlow).Run at line 320
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).Run at line 731
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRun at line 1698
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll at line 1421
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithDistSQLEngine at line 1579
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).dispatchToExecutionEngine at line 1193
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmtInOpenState at line 689
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt.func1 at line 131
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithProfiling at line 2420
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt at line 130
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCmd.func1 at line 1932
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCmd at line 1936
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).run at line 1858
pkg/sql/conn_executor.go in pkg/sql.(*Server).ServeConn at line 832
pkg/sql/pgwire/conn.go in pkg/sql/pgwire.(*conn).processCommandsAsync.func1 at line 728
src/runtime/asm_amd64.s in runtime.goexit at line 1594
Tag Value
Cockroach Release v22.2.2
Cockroach SHA: 07a53a3
Platform darwin amd64
Distribution CCL
Environment v22.2.2
Command start-single-node
Go Version ``
# of CPUs
# of Goroutines

Jira issue: CRDB-23270

Metadata

Metadata

Assignees

Labels

C-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.O-sentryOriginated from an in-the-wild panic report.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions