Skip to content

Releases: apple/swift-collections

Swift Collections 1.4.1

18 Mar 22:17
6675bc0

Choose a tag to compare

This patch release is mostly focusing on evolving the package traits UnstableContainersPreview and UnstableHashedContainers, with the following notable fixes and improvements to the stable parts of the package:

  • Make the package documentation build successfully on the DocC that ships in Swift 6.2.
  • Avoid using floating point arithmetic to size collection storage in the DequeModule and OrderedCollections modules.

Changes to experimental package traits

The new set and dictionary types enabled by the UnstableHashedContainers trait have now resolved several correctness issues in their implementation of insertions. They have also gained some low-hanging performance optimizations. Like before, these types are in "working prototype" phase, and while they have working implementations of basic primitive operations, we haven't done much work validating their performance yet. Feedback from intrepid early adopters would be very welcome.

The UnstableContainersPreview trait has gained several new protocols and algorithm implementations, working towards one possible working model of a coherent, ownership-aware container/iteration model.

  • BidirectionalContainer defines a container that allows iterating over spans backwards, and provides decrement operations on indices -- an analogue of the classic BidirectionalCollection protocol.
  • RandomAccessContainer models containers that allow constant-time repositioning of their indices, like RandomAccessCollection.
  • MutableContainer is the ownership-aware analogue of MutableCollection -- it models a container type that allows its elements to be arbitrarily reordered and mutated/reassigned without changing the shape of the data structure (that is to say, without invalidating any indices).
  • PermutableContainer is an experimental new spinoff of MutableContainer, focusing on reordering items without allowing arbitrary mutations.
  • RangeReplaceableContainer is a partial, ownership-aware analogue of RangeReplaceableCollection, providing a full set of insertion/append/removal/consumption operations, with support for fixed-capacity conforming types.
  • DynamicContainer rounds out the range-replacement operations with initializer and capacity reservation requirements that can only be implemented by dynamically sized containers.
  • We now have working reference implementations of lazy map, reduce and filter operations on borrowing iterators, producers and drains, as well a collect(into:) family of methods to supply "greedy" variants, generating items into a container of the user's choice. Importantly, the algorithms tend to be defined on the iterator types, rather than directly on some sequence/container -- going this way has some interesting benefits (explicitness, no confusion between the various flavors or the existing Sequence algorithms), but they also have notable drawbacks (minor design issues with the borrowing iterator protocol, unknowns on how the pattern would apply to container algorithms, etc.).
    let items: RigidArray<Int> = ...
    let transformed = 
      items.makeBorrowingIterator() // obviously we'd want a better name here, like `borrow()`
      .map { 2 * $0 }
      .collect(into: UniqueArray.self)
    // `transformed` is a UniqueArray instance holding all values in `items`, doubled up 
    let items: RigidArray = ...
    let transformed = 
       items.makeBorrowingIterator()
      .filter { !$0.isMultiple(of: 7) }
      .copy()
      .collect(into: UniqueArray.self)
    // `transformed` holds a copy of all values in `items` that aren't a multiple of 7
    let items: RigidArray = ...
    let transformed = 
       items.consumeAll()
      .filter { !$0.isMultiple(of: 7) }
      .collect(into: UniqueArray.self)
    // `transformed` holds all values that were previously in `items` that aren't a multiple of 7. `items` is now empty.

Like before, these are highly experimental, and they will definitely change in dramatic/radical ways on the way to stabilization. Note that there is no project- or team-wide consensus on any of these constructs. I'm publishing them primarily as a crucial reference point, and to gain a level of shared understanding of the actual problems that need to be resolved, and the consequences of the design path we are on.

What's Changed

  • Add some decorative badges in the README by @lorentey in #591
  • [Dequemodule, OrderedCollections] Avoid using floating point arithmetic by @lorentey in #592
  • Enforce dress code for license headers by @lorentey in #593
  • Bump swiftlang/github-workflows/.github/workflows/soundness.yml from 0.0.7 to 0.0.8 by @dependabot[bot] in #595
  • Documentation updates for latest DocC by @lorentey in #596
  • [BasicContainers] Allow standalone use of the UnstableHashedContainers trait by @lorentey in #597
  • Bump swiftlang/github-workflows/.github/workflows/swift_package_test.yml from 0.0.7 to 0.0.8 by @dependabot[bot] in #594
  • [ContainersPreview] Rename Producer.generateNext() to next() by @lorentey in #599
  • [ContainersPreview] Remove BorrowingSequence.first by @lorentey in #598
  • [CI] Enable Android testing by @marcprux in #558
  • [BasicContainers] Assorted hashed container fixes and improvements by @lorentey in #601
  • Flesh out BorrowingSequence/Container/Producer model a little more by @lorentey in #603
  • More exploration of ownership-aware container/iterator algorithms by @lorentey in #605

New Contributors

Full Changelog: 1.4.0...1.4.1

Swift Collections 1.4.0

07 Mar 00:33
8d9834a

Choose a tag to compare

This feature release supports Swift toolchain versions 6.0, 6.1 and 6.2. It includes a variety of bug fixes, and ships the following new features:

New ownership-aware ring buffer and hashed container implementations

In the DequeModule module, we have two new source-stable types that provide ownership-aware ring buffer implementations:

RigidDeque/UniqueDeque are to Deque like RigidArray/UniqueArray are to Array -- they provide noncopyable embodiments of the same basic data structure, with many of the same operations.

In the BasicContainers module, this release adds previews of four new types, implementing ownership-aware hashed containers:

These are direct analogues of the standard Set and Dictionary types. These types are built on top of the Equatable and Hashable protocol generalizations that were proposed in SE-0499; as that proposal is not yet implemented in any shipping toolchain, these new types are shipping as source-unstable previews, conditional on a new UnstableHashedContainers package trait. The final API of these types will also deeply depend on the struct Borrow and struct Inout proposals (and potentially other language/stdlib improvements) that are currently working their way through the Swift Evolution process. Accordingly, we may need to make source-breaking changes to the interfaces of these types -- they are not ready to be blessed as Public API. However, we encourage intrepid engineers to try them on for size, and report pain points. (Of which we expect there will be many in this first preview.)

We continue the pattern of Rigid- and Unique- naming prefixes with these new types:

  • The Unique types (UniqueArray, UniqueDeque, UniqueSet, UniqueDictionary etc.) are dynamically self-sizing containers that automatically reallocate their storage as needed to best accommodate their contents; the Unique prefix was chosen to highlight that these types are always uniquely held, avoiding the complications of mutating shared copies.
  • The Rigid types remove dynamic sizing, and they operate strictly within an explicitly configured capacity. Dynamic sizing is not always appropriate -- when targeting space- or time-constrained environments (think embedded use cases or real-time work), it is preferable to avoid implicit reallocations, and to instead choose to have explicit control over when (and if) storage is reallocated, and to what size. This is where the Rigid types come in: their instances are created with a specific capacity and it is a runtime error to exceed that. This makes them quite inflexible (hence the "rigid" qualifier), but in exchange, their operations provide far stricter complexity guarantees: they exhibit no random runtime latency spikes, and they can trivially fit in strict memory budgets.

Early drafts of borrowing sequence, generative iteration and container protocols

This release includes highly experimental but working implementations of new protocols supplying ownership-aware alternatives to the classic Sequence/Collection protocol hierarchy. These protocols and the generic operations built on top of them can be turned on by enabling the UnstableContainersPreview package trait.

In this version, the package has developed these protocols just enough to implement basic generic operations for moving data between containers like UniqueArray and RigidDeque. As we gain experience using these, future releases may start adding basic generic algorithms, more protocols (bidirectional, random-access, (per)mutable, range-replaceable containers etc.) convenience adapters, and other features -- or we may end up entirely overhauling or simply discarding some/all of them. Accordingly, the experimental interfaces enabled by UnstableContainersPreview are not source stable, and they are not intended for production use. We expect the eventual production version of these (or whatever designs they evolve into) to ship in the Swift Standard Library. We do highly recommend interested folks to try playing with these, to get a feel for the strange problems of Ownership.

Besides these protocols, the package also defines rudimentary substitutes of some basic primitives that belong in the Standard Library:

  • struct InputSpan<Element> the dual of OutputSpan -- while OutputSpan is primarily for moving items into somebody else's storage, InputSpan enables safely moving items out of storage.
  • struct Borrow<Target> represents a borrowing reference to an item. (This package models this with a pointer, which is an ill-fitting substitute for the real implementation in the stdlib.)
  • struct Inout<Target> represents a mutating reference to an item.

A formal way to access SortedSet and SortedDictionary types

The SortedCollections module contains (preexisting) early drafts of two sorted collection types SortedSet and SortedDictionary, built on top of an in-memory B-tree implementation. This release defines an UnstableSortedCollections package trait that can be used to enable building these types for experimentation without manually modifying the package. Like in previous releases, these implementations remain unfinished in this release, with known API issues; accordingly, these types remain unstable. (Issue #1 remains open.) Future package releases may change their interface in ways that break source compatibility, or they may remove these types altogether.

Minor interface-level changes

  • The Collections module no longer uses the unstable @_exported import feature. Instead, it publishes public typealiases of every type that it previously reexported from DequeModule, OrderedCollections, BitCollections, HeapModule and HashTreeCollections.

  • We renamed some RigidArray/UniqueArray operations to improve their clarity at the point of use. The old names are still available, but deprecated.

    Old name New name
    append(count:initializingWith:) append(addingCount:initializingWith:)
    insert(count:at:initializingWith:) insert(addingCount:at:initializingWith:)
    replaceSubrange(_:newCount:initializingWith:) replace(removing:addingCount:initializingWith:)
    replaceSubrange(_:moving:) replace(removing:moving:)
    replaceSubrange(_:copying:) replace(removing:copying:)
    copy() clone()
    copy(capacity:) clone(capacity:)
  • We have now defined a complete set of OutputSpan/InputSpan-based append/insert/replace/consume primitives, fully generalized to be implementable by piecewise contiguous containers. These operations pave the way for a Container-based analogue of the classic RangeReplaceableCollection protocol, with most of the user-facing operations becoming standard generic algorithms built on top of these primitives:

    mutating func append<E: Error>(
        addingCount newItemCount: Int,
        initializingWith initializer: (inout OutputSpan<Elemen...
    
Read more

Swift Collections 1.3.0

29 Sep 17:06
7b847a3

Choose a tag to compare

This feature release supports Swift toolchain versions 6.0, 6.1 and 6.2, and it includes the following improvements:

BasicContainers module

This new module collects ownership-aware, low-level variants of existing data structures in the core standard library. In this release, this module consists of two array variants, UniqueArray and RigidArray.

These new types are provided as less flexible, noncopyable alternatives to the classic Array type. The standard Array implements value semantics with the copy-on-write optimization; this inherently requires elements to be copyable, and it is itself copyable.

struct UniqueArray<Element> is a noncopyable array variant that takes away Array's copy-on-write behavior, enabling support for noncopyable elements. This type's noncopyability means mutations can always assume that the array is uniquely owned, with no shared copies (hence the name!). This means that array mutations such as mutating an element at an index can behave much more predictably, with no unexpected performance spikes due to having to copy shared storage.

struct RigidArray<Element> goes even further, by also disabling dynamic resizing. Rigid arrays have a fixed capacity: they are initialized with room for a particular number of elements, and they never implicitly grow (nor shrink) their storage. When a rigid array's count reaches its capacity, it becomes unable to add any new items -- inserting into a full array is considered a programming error. This makes this a quite inflexible (or rigid) type indeed, as avoiding storage overflow requires careful, up front planning on the resource needs of the task at hand. In exchange, rigid arrays can have extremely predictable performance characteristics.

UniqueArray is a great default choice when a task just needs an array type that is able store noncopyable elements. RigidArray is best reserved for use cases that require absolute, pedantic control over memory use or latency -- such as control software running in environments with extremely limited memory, or when a certain task must always be completed in some given amount of time.

The Unique and Rigid prefixes applied here establish a general naming convention for low-level variants of the classic copy-on-write data structure implementations. Future releases are expected to flesh out our zoo of container types by adding Unique and Rigid variants of the existing Set, Dictionary, Deque, Heap and other constructs, with type names such as as RigidDictionary and UniqueDeque.

TrailingElementsModule module

This new module ships a new TrailingArray construct, a preview of a new low-level, ownership-aware variant of ManagedBuffer. This is primarily intended as a interoperability helper for C constructs that consist of a fixed-size header directly followed by variable-size storage buffer.

ContainersPreview module

This module is intended to contain previews of an upcoming ownership-aware container model. In this initial release, this module consists of just one construct: struct Box<T>.

Box is a wrapper type that forms a noncopyable, heap allocated box around an arbitrary value.

What's Changed

Read more

Swift Collections 1.1.6

28 Jul 17:06
c11818f

Choose a tag to compare

This is a patch release updating the CMake build configuration that is used to build Swift toolchains. There were no changes to the package.

What's Changed

  • 1.1: Includes the DequeModule for use in the Foundation toolchain build by @cthielen #500

Full Changelog: 1.1.5...1.1.6

Swift Collections 1.2.1

23 Jul 23:50
8c0c0a8

Choose a tag to compare

This is a patch release with the following minor improvements:

  • BigString sometimes miscounted distances in its character view, resulting in an invalid collection conformance. This is now fixed. (#485)
  • BigString's Unicode Scalar and character views now make better use of known lengths of the text chunks stored in the tree, resulting in significantly improved performance for their distance measurements. (#486)
  • The Foundation-specific toolchain configuration was updated to include the Deque type. (#496)

What's Changed

  • [BigString] Fix character indexing operations by @lorentey in #485
  • [BigString] Harvest some low-hanging performance fruit by @lorentey in #486
  • Include DequeModule in the Foundation toolchain build by @cthielen in #496

Full Changelog: 1.2.0...1.2.1

Swift Collections 1.1.5

02 Jul 21:16
ad9f672

Choose a tag to compare

This is a patch release updating the CMake build configuration that is used to build Swift toolchains. There were no changes to the package.

What's Changed

  • 1.1: Use full module triple for Swift modules by @etcwilde in #492

Full Changelog: 1.1.4...1.1.5

Swift Collections 1.2.0

19 May 18:12
c180559

Choose a tag to compare

This feature release includes the following improvements:

  • The package now compiles without warnings using Swift 6.0 and 6.1.
  • New functionality:
    • Heap.removeAll(where:) (#454)
    • OrderedSet.appending(contentsOf:) (#452)
  • Bug fixes and performance improvements:
    • Heap operations now agree on the identity of the maximal element, even if it has duplicates (#439)
    • OrderedSet now runs faster in unspecialized generic contexts (#433)
    • Building on OpenBSD no longer requires ManagedBuffer.capacity (#456)

This version supports Swift toolchain versions 5.10, 6.0 and 6.1.

What's Changed

New Contributors

Full Changelog: 1.1.4...1.2.0

Swift Collections 1.1.4

24 Sep 23:21
671108c

Choose a tag to compare

This patch release consists of changes to the (unstable) CMake configuration. It includes no code level modifications.

This is expected to be the last planned release in the 1.1 release series. The next tagged release will be 1.2.0, bumping the required Swift toolchain to 5.9.

What's Changed

New Contributors

Full Changelog: 1.1.3...1.1.4

Swift Collections 1.1.3

26 Aug 17:35
9bf03ff

Choose a tag to compare

This patch release ships bug fixes for issues discovered since 1.1.2.

What's Changed

New Contributors

Full Changelog: 1.1.2...1.1.3

Swift Collections 1.1.2

08 Jul 22:04
3d2dc41

Choose a tag to compare

This patch release updates the (unstable) CMake build configuration to support the swift-foundation project.

There were no changes outside of the CMake configuration.

What's Changed

  • Install the Foundation toolchain module during the static swift build by @jmschonfeld in #391
  • [CMake] Reduce path lengths in single-module build by @jmschonfeld in #392
  • Reduce the size of the _FoundationCollections toolchain module by @jmschonfeld in #395

Full Changelog: 1.1.1...1.1.2