Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add content from typeshed/CONTRIBUTING.md #1882

Merged
merged 15 commits into from
Dec 17, 2024
158 changes: 141 additions & 17 deletions docs/guides/writing_stubs.rst
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,11 @@ Liskov substitutability or detecting problematic overloads.
It may be instructive to examine `typeshed <https://github.com/python/typeshed/>`__'s
`setup for testing stubs <https://github.com/python/typeshed/blob/main/tests/README.md>`__.

To suppress type errors on stubs:
* use mypy error codes for mypy-specific `# type: ignore` annotations, e.g. `# type: ignore[override]` for Liskov Substitution Principle violations.
* use pyright error codes for pyright-specific suppressions, e.g. `# pyright: ignore[reportGeneralTypeIssues]`. Pyright is configured to discard `# type: ignore` annotations.
yangdanny97 marked this conversation as resolved.
Show resolved Hide resolved
* If you need both on the same line, mypy's annotation needs to go first, e.g. `# type: ignore[override] # pyright: ignore[reportGeneralTypeIssues]`.

..
TODO: consider adding examples and configurations for specific type checkers

Expand All @@ -113,18 +118,6 @@ Stub Content
This section documents best practices on what elements to include or
leave out of stub files.

Modules excluded fom stubs
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I moved this down cuz it felt weird for the "stub content" section to start with "what you shouldn't include"

--------------------------

Not all modules should be included in stubs.

It is recommended to exclude:

1. Implementation details, with `multiprocessing/popen_spawn_win32.py <https://github.com/python/cpython/blob/main/Lib/multiprocessing/popen_spawn_win32.py>`_ as a notable example
2. Modules that are not supposed to be imported, such as ``__main__.py``
3. Protected modules that start with a single ``_`` char. However, when needed protected modules can still be added (see :ref:`undocumented-objects` section below)
4. Tests

Public Interface
----------------

Expand All @@ -138,7 +131,17 @@ The following should always be included:
* All objects included in ``__all__`` (if present).

Other objects may be included if they are not prefixed with an underscore
or if they are being used in practice. (See the next section.)
or if they are being used in practice.

Modules excluded from stubs
---------------------------

The following should not be included in stubs:

1. Implementation details, with `multiprocessing/popen_spawn_win32.py <https://github.com/python/cpython/blob/main/Lib/multiprocessing/popen_spawn_win32.py>`_ as a notable example
2. Modules that are not supposed to be imported, such as ``__main__.py``
3. Protected modules that start with a single ``_`` char. However, when needed protected modules can still be added (see :ref:`undocumented-objects` section below)
4. Tests

.. _undocumented-objects:

Expand Down Expand Up @@ -417,6 +420,28 @@ and the :ref:`best-practices`. There are a few exceptions, outlined below, that
different structure of stub files into account and aim to create
more concise files.

Syntax Example
--------------

The below is an excerpt from the types for the `datetime` module.

MAXYEAR: int
MINYEAR: int

class date:
def __new__(cls, year: SupportsIndex, month: SupportsIndex, day: SupportsIndex) -> Self: ...
@classmethod
def fromtimestamp(cls, timestamp: float, /) -> Self: ...
@classmethod
def today(cls) -> Self: ...
@classmethod
def fromordinal(cls, n: int, /) -> Self: ...
@property
def year(self) -> int: ...
def replace(self, year: SupportsIndex = ..., month: SupportsIndex = ..., day: SupportsIndex = ...) -> Self: ...
def ctime(self) -> str: ...
def weekday(self) -> int: ...

Maximum Line Length
-------------------

Expand Down Expand Up @@ -448,14 +473,14 @@ No::

def time_func() -> None: ...

def date_func() -> None: ... # do no leave unnecessary empty lines
def date_func() -> None: ... # do not leave unnecessary empty lines

def ip_func() -> None: ...


class Foo: # leave only one empty line above
x: int
class MyError(Exception): ... # leave an empty line between the classes
yangdanny97 marked this conversation as resolved.
Show resolved Hide resolved
class MyError(Exception): ...

Module Level Attributes
-----------------------
Expand Down Expand Up @@ -505,7 +530,7 @@ Yes::

class Color(Enum):
# An assignment with no type annotation is a convention used to indicate
# an enum member.
# an enum member.
RED = 1

No::
Expand Down Expand Up @@ -575,6 +600,14 @@ No::
...
def to_int3(x: str) -> int: pass

Avoid invariant collection types (`list`, `dict`) for function parameters,
in favor of covariant types like `Mapping` or `Sequence`.

Avoid union return types. See https://github.com/python/mypy/issues/1693
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably for a future PR, but it would be nice if the content of python/mypy#1693 and python/mypy#7214 below could be copied into the guides. Having pieces of general typing advice hidden away in mypy issues feels sort of odd.


Use `float` instead of `int | float` for parameter annotations.
See [PEP 484](https://peps.python.org/pep-0484/#the-numeric-tower).

Language Features
-----------------

Expand Down Expand Up @@ -604,6 +637,14 @@ No::

class OtherClass: ...

Use variable annotations instead of type comments, even for stubs that target
older versions of Python.

Platform-dependent APIs
-----------------------

Use platform checks like `if sys.platform == 'win32'` to denote platform-dependent APIs.
yangdanny97 marked this conversation as resolved.
Show resolved Hide resolved

NamedTuple and TypedDict
------------------------

Expand Down Expand Up @@ -631,7 +672,7 @@ No::
Built-in Generics
-----------------

:pep:`585` built-in generics are supported and should be used instead
:pep:`585` built-in generics (such as `list`, `dict`, `tuple`, `set`) are supported and should be used instead
yangdanny97 marked this conversation as resolved.
Show resolved Hide resolved
of the corresponding types from ``typing``::

from collections import defaultdict
Expand All @@ -654,3 +695,86 @@ all type checkers::

def foo(x: int | str) -> int | None: ... # recommended
def foo(x: Union[int, str]) -> Optional[int]: ... # ok

Using `Any` and `object`
yangdanny97 marked this conversation as resolved.
Show resolved Hide resolved
------------------------

When adding type hints, avoid using the `Any` type when possible. Reserve
the use of `Any` for when:
* the correct type cannot be expressed in the current type system; and
* to avoid union returns (see above).

Note that `Any` is not the correct type to use if you want to indicate
that some function can accept literally anything: in those cases use
`object` instead.

When using `Any`, document the reason for using it in a comment. Ideally,
document what types could be used.

Context Managers
----------------

When adding type annotations for context manager classes, annotate
the return type of `__exit__` as bool only if the context manager
yangdanny97 marked this conversation as resolved.
Show resolved Hide resolved
sometimes suppresses exceptions -- if it sometimes returns `True`
at runtime. If the context manager never suppresses exceptions,
have the return type be either `None` or `bool | None`. If you
are not sure whether exceptions are suppressed or not or if the
context manager is meant to be subclassed, pick `bool | None`.
See https://github.com/python/mypy/issues/7214 for more details.

`__enter__` methods and other methods that return instances of the
current class should be annotated with `typing_extensions.Self`
yangdanny97 marked this conversation as resolved.
Show resolved Hide resolved
([example](https://github.com/python/typeshed/blob/3581846/stdlib/contextlib.pyi#L151)).

Naming
------

Type variables and aliases you introduce purely for legibility reasons
should be prefixed with an underscore to make it obvious to the reader
they are not part of the stubbed API.

A few guidelines for protocol names below. In cases that don't fall
into any of those categories, use your best judgement.

* Use plain names for protocols that represent a clear concept
(e.g. `Iterator`, `Container`).
* Use `SupportsX` for protocols that provide callable methods (e.g.
`SupportsInt`, `SupportsRead`, `SupportsReadSeek`).
* Use `HasX` for protocols that have readable and/or writable attributes
or getter/setter methods (e.g. `HasItems`, `HasFileno`).

`@deprecated`
-------------

The `@typing_extensions.deprecated` decorator (`@warnings.deprecated`
since Python 3.13) can be used to mark deprecated functionality; see
[PEP 702](https://peps.python.org/pep-0702/).

A few guidelines for how to use it:

* In the standard library, apply the decorator only in Python versions
where an appropriate replacement for the deprecated functionality
exists. If in doubt, apply the decorator only on versions where the
functionality has been explicitly deprecated, either through runtime
warnings or in the documentation. Use `if sys.version_info` checks to
apply the decorator only to some versions.
yangdanny97 marked this conversation as resolved.
Show resolved Hide resolved
* Keep the deprecation message concise, but try to mention the projected
version when the functionality is to be removed, and a suggested
replacement.

Imports
yangdanny97 marked this conversation as resolved.
Show resolved Hide resolved
-------

Imports in stubs are considered private (not part of the exported API)
unless:
* they use the form ``from library import name as name`` (sic, using explicit ``as`` even if the name stays the same); or
* they use the form ``from library import *`` which means all names from that library are exported.

Forward References
------------------

Stub files support forward references natively. In other words, the
order of class declarations and type aliases does not matter in
a stub file. Unlike regular Python files, you can use the name of the class within its own
body without writing it as a comment.