(cherry picked from commit e310af9)

Co-authored-by: James Abel <[email protected]>

(cherry picked from commit 5dfbb4d)

Co-authored-by: Hansraj Das <[email protected]>

…o stderr. (GH-16583)

It now escapes them with a backslash, as the regular Python interpreter.
Added the "errors" field to the standard streams.
(cherry picked from commit b690a27)

Co-authored-by: Serhiy Storchaka <[email protected]>

Valgrind emits "Conditional jump or move depends on uninitialised
value(s)" false alarms on GCC builtin strcmp() function. The GCC code
is correct.

Valgrind bug: https://bugs.kde.org/show_bug.cgi?id=264936
(cherry picked from commit 03ab6b4)

Co-authored-by: Victor Stinner <[email protected]>

…H-16641)

(cherry picked from commit 13abda4)

Co-authored-by: Serhiy Storchaka <[email protected]>

(cherry picked from commit 8252c52)

Co-authored-by: Serhiy Storchaka <[email protected]>

…H-16662)

The implementation of weakref.proxy's methods call back into the Python
API using a borrowed references of the weakly referenced object
(acquired via PyWeakref_GET_OBJECT). This API call may delete the last
reference to the object (either directly or via GC), leaving a dangling
pointer, which can be subsequently dereferenced.

To fix this, claim a temporary ownership of the referenced object when
calling the appropriate method. Some functions because at the moment they
do not need to access the borrowed referent, but to protect against
future changes to these functions, ownership need to be fixed in
all potentially affected methods..
(cherry picked from commit 10cd00a)

Co-authored-by: Pablo Galindo <[email protected]>

(cherry picked from commit 01171eb)

Co-authored-by: Hansraj Das <[email protected]>

…/unions. (GH-16589) (GH-16671)

(cherry picked from commit e8bedbd)

bpo-37531, bpo-38207: On timeout, regrtest no longer attempts to call
`popen.communicate() again: it can hang until all child processes
using stdout and stderr pipes completes. Kill the worker process and
ignores its output.

Reenable test_regrtest.test_multiprocessing_timeout().

bpo-37531: Change also the faulthandler timeout of the main process
from 1 minute to 5 minutes, for Python slowest buildbots.
(cherry picked from commit 0ec618a)

Co-authored-by: Victor Stinner <[email protected]>

…H-16658) (GH-16683)

* [bpo-38379](https://bugs.python.org/issue38379):  when a finalizer resurrects an object,
nothing is actually collected in this run of gc.
Change the stats to relect that truth.
(cherry picked from commit ecbf35f)

Co-authored-by: Tim Peters <[email protected]>





https://bugs.python.org/issue38379



Automerge-Triggered-By: @pablogsal

(cherry picked from commit 09895c2)

(cherry picked from commit a05fcd3)

Co-authored-by: Dong-hee Na <[email protected]>

PR GH-4906 changed the typing.Generic class hierarchy, leaving an
outdated comment in the library reference. User-defined Generic ABCs now
must get a abc.ABCMeta metaclass from something other than typing.Generic
inheritance.
(cherry picked from commit d47f0dd)

Co-authored-by: M. Eric Irrgang <[email protected]>

Add missing stat.S_IFDOOR, stat.S_IFPORT, stat.S_IFWHT,
stat.S_ISDOOR, stat.S_ISPORT, and stat.S_ISWHT values to
the Python implementation of the stat module.
(cherry picked from commit 7bb1431)

Co-authored-by: Ronan Lamy <[email protected]>

…-16591)

(cherry picked from commit 1dbe537)

Co-authored-by: Dong-hee Na <[email protected]>

(cherry picked from commit f900064)

Co-authored-by: Kyle Stanley <[email protected]>

(cherry picked from commit a8e0d31)

Co-authored-by: Hansraj Das <[email protected]>

…H-16536)

 pathfix.py: Assume all files that end on '.py' are Python scripts when working recursively.
(cherry picked from commit 2b7dc40)

Co-authored-by: Ruediger Pluem <[email protected]>

We no longer use AppVeyor on 3.x, and others were still pointed at master.

(cherry picked from commit dd6117c)

Co-authored-by: bariod <[email protected]>

)

Add SMTPNotSupportedError in the exports of smtplib

Co-Authored-By: Brandt Bucher <[email protected]>
(cherry picked from commit 3faf826)

Co-authored-by: nde <[email protected]>

…low oper parsing of URLs" (GH-16724) (GH-16728)

This reverts commit 87bd207.

The reason for revert is a regression caused by the change in 3.8.0rc1, see bpo-38449 for more details.

https://bugs.python.org/issue38449
(cherry picked from commit 19a3d87)

Co-authored-by: Abhilash Raj <[email protected]>

KeyError should cause a failure in parsing the encoded word and should be caught and raised as a _InvalidEWError instead.
(cherry picked from commit 65dcc8a)

Co-authored-by: Andrei Troie <[email protected]>

This is a fairly noticeable change that requires adjustments in
existing asyncio code. It should therefore be announced.
(cherry picked from commit e634da2)

Co-authored-by: Phil Jones <[email protected]>

…IX_C_SOURCE (GH-16733)

(cherry picked from commit 8177404)

Co-authored-by: Pablo Galindo <[email protected]>

GH-16702)

(cherry picked from commit 793cb85)

Co-authored-by: Samuel Colvin <[email protected]>

(cherry picked from commit e3babbd)

Co-authored-by: Pablo Galindo <[email protected]>

…ocs (GH-16743)

Metaclass was removed in Python 3.7 (there is already a `versionchanged` item about this).

https://bugs.python.org/issue28556
(cherry picked from commit 8144095)

Co-authored-by: Ivan Levkivskyi <[email protected]>

(cherry picked from commit fdfe283)

Co-authored-by: Sebastian Rittau <[email protected]>

* Use Unicode character for accent
* Various grammar fixes
* Sort library modules alphabetically; remove duplicated idlelib/IDLE section
(cherry picked from commit bb78f6c)

Co-authored-by: Andrew Kuchling <[email protected]>

(cherry picked from commit c39d1dd)

Co-authored-by: Dong-hee Na <[email protected]>

…H-16758)

(cherry picked from commit 8a6cbf8)

Co-authored-by: Raymond Hettinger <[email protected]>

…6762)

* bpo-38461: ncurses misspelled as curses

* bpo-38463: Fix broken link
(cherry picked from commit 61a6db5)

Co-authored-by: Raymond Hettinger <[email protected]>

)

(cherry picked from commit a329153)

Co-authored-by: Raymond Hettinger <[email protected]>

GH-16755) (#16760)

The symbol table handing of PEP572's assignment expressions is not resolving correctly the scope of some variables in presence of global/nonlocal keywords in conjunction with comprehensions.
(cherry picked from commit fd5c414)

Co-authored-by: Pablo Galindo <[email protected]>

(cherry picked from commit 19d6842)

Co-authored-by: Ned Deily <[email protected]>

(cherry picked from commit 298439c)

Co-authored-by: Serhiy Storchaka <[email protected]>

(cherry picked from commit d83fc27)

Co-authored-by: Steve Dower <[email protected]>

(cherry picked from commit 274bd01)

Co-authored-by: Raymond Hettinger <[email protected]>

Python 3.8.0

* [3.8] bpo-38456: Use /bin/true in test_subprocess (GH-16736)

Instead of sys.executable, "-c", "pass" or "import sys; sys.exit(0)"
use /bin/true when it is available.  On a reasonable machine this
shaves up to two seconds wall time off the otherwise ~40sec execution
on a --with-pydebug build.  It should be more notable on many
buildbots or overloaded slower I/O systems (CI, etc)..
(cherry picked from commit 67b93f8)

* Handle when there is no 'true' command

backport of 46113e0 by Pablo Galindo.

(cherry picked from commit 4504b45)

Co-authored-by: Julien Palard <[email protected]>

(cherry picked from commit 4d20228)

Co-authored-by: Steve Dower <[email protected]>

* bpo-36389: _PyObject_CheckConsistency() available in release mode (GH-16612)

bpo-36389, bpo-38376: The _PyObject_CheckConsistency() function is
now also available in release mode. For example, it can be used to
debug a crash in the visit_decref() function of the GC.

Modify the following functions to also work in release mode:

* _PyDict_CheckConsistency()
* _PyObject_CheckConsistency()
* _PyType_CheckConsistency()
* _PyUnicode_CheckConsistency()

Other changes:

* _PyMem_IsPtrFreed(ptr) now also returns 1 if ptr is NULL
  (equals to 0).
* _PyBytesWriter_CheckConsistency() now returns 1 and is only used
  with assert().
* Reorder _PyObject_Dump() to write safe fields first, and only
  attempt to render repr() at the end.

(cherry picked from commit 6876257)

* bpo-36389: Fix _PyBytesWriter in release mode (GH-16624)

Fix _PyBytesWriter API when Python is built in release mode with
assertions.

(cherry picked from commit 60ec6ef)

* bpo-38070: Enhance visit_decref() debug trace (GH-16631)

subtract_refs() now pass the parent object to visit_decref() which
pass it to _PyObject_ASSERT(). So if the "is freed" assertion fails,
the parent is used in debug trace, rather than the freed object. The
parent object is more likely to contain useful information. Freed
objects cannot be inspected are are displayed as "<object at xxx is
freed>" with no other detail.

(cherry picked from commit 4d5f94b)

* Fix also a typo in PYMEM_DEADBYTE macro comment

* bpo-36389: Add newline to _PyObject_AssertFailed() (GH-16629)

Add a newline between the verbose object dump and the Py_FatalError()
logs for readability.

(cherry picked from commit 7775349)

…onal-only parameter (GH-16800)

(cherry picked from commit f3ef06a)

Co-authored-by: Pablo Galindo <[email protected]>

(cherry picked from commit 2798b60)

Co-authored-by: Hansraj Das <[email protected]>

(cherry picked from commit 3f36043)

Co-authored-by: Ned Deily <[email protected]>

main() is now responsible to send the ANSWER, rather than
ServerProto. main() now waits until it got the HELLO before sending
the ANSWER over the new transport.

Previously, there was a race condition between main() replacing the
protocol and the protocol sending the ANSWER once it gets the HELLO.

TLSv1.3 was disabled for the test: reenable it.
(cherry picked from commit fab4ef2)

Co-authored-by: Victor Stinner <[email protected]>

…GH-16824)

(cherry picked from commit 7aebbd1)

Co-authored-by: Steve Dower <[email protected]>

Also updates the documentation to clarify the situation surrounding
the digestmod parameter that is required despite its position in the
argument list as of 3.8.0 as well as removing old python2 era
references to "binary strings".

We indavertently had this raise ValueError in 3.8.0 for the missing
arg.  This is not considered an API change as no reasonable code would
be catching this missing argument error in order to handle it.
(cherry picked from commit f33c57d)

Co-authored-by: Gregory P. Smith <[email protected]>

(cherry picked from commit 93b81e1)

Co-authored-by: Stéphane Wirtel <[email protected]>

Added periods at the end of the sentences.
(cherry picked from commit b1fa72a)

Co-authored-by: Jero Bado <[email protected]>

* bpo-27657: Fix urlparse() with numeric paths

Revert parsing decision from bpo-754016 in favor of the documented
consensus in bpo-16932 of how to treat strings without a // to
designate the netloc.

* bpo-22891: Remove urlsplit() optimization for 'http' prefixed inputs.
(cherry picked from commit 5a88d50)

Co-authored-by: Tim Graham <[email protected]>

…H-16670)

https://bugs.python.org/issue38418

Automerge-Triggered-By: @zooba
(cherry picked from commit fbe3c76)

Co-authored-by: Steve Dower <[email protected]>

(cherry picked from commit 5eabec0)

Co-authored-by: Raymond Hettinger <[email protected]>

The Nose package is no longer maintained.
(cherry picked from commit 88eeda6)

Co-authored-by: Jon Dufresne <[email protected]>

…mpty dict (GH-16846)

The reverse iterator for empty dictionaries was not handling correctly shared-key dictionaries.
(cherry picked from commit 24dc2f8)

Co-authored-by: Dong-hee Na <[email protected]>

* math.perm() and math.comb()

* math.isqrt()

* Add singledispatchmethod()

* itertools.accumulate()

* Optional headers for xmlrpc.client.ServerProxy

* IDLE non-BMP characters

* import collections.abc directly

* @coroutine is deprecated

* pprint.pp()

* New options for object.__reduce__()

* DictReader no longer returns OrderedDicts

* "force" option for logging.basicConfig()

* Fix spelling

* cProfile context manager

* Various markup/grammar fixes from Kyle Stanley.
Other minor fixes as well.
Also, dedup the __reduce__ entry.

* Fix markup

* Fix grammar nits found by MS Word
(cherry picked from commit c93883c)

Co-authored-by: Raymond Hettinger <[email protected]>

(cherry picked from commit 7414207)

Co-authored-by: Batuhan Taşkaya <[email protected]>

…H-16869)

(cherry picked from commit 5bc6a7c)

Co-authored-by: Serhiy Storchaka <[email protected]>

…H-16860)

(cherry picked from commit 10ecbad)

Co-authored-by: Serhiy Storchaka <[email protected]>

Fix stdatomic.h header check for ICC compiler: the ICC implementation
lacks atomic_uintptr_t type which is needed by Python.

Test:

* atomic_int and atomic_uintptr_t types
* atomic_load_explicit() and atomic_store_explicit()
* memory_order_relaxed and memory_order_seq_cst constants

But don't test ATOMIC_VAR_INIT(): it's not used in Python.
(cherry picked from commit 028f734)

Co-authored-by: Victor Stinner <[email protected]>

(cherry picked from commit 91528f4)

Co-authored-by: Daniel Baskal <[email protected]>

(cherry picked from commit dfe726b)

Co-authored-by: Kyle Stanley <[email protected]>

(cherry picked from commit 2e3d873)

Co-authored-by: Serhiy Storchaka <[email protected]>

(cherry picked from commit d34ac30)

Co-authored-by: Peter Bittner <[email protected]>

…GH-16901)

bpo-34679, bpo-38563: asyncio.ProactorEventLoop.close() now only calls
signal.set_wakeup_fd() in the main thread.
(cherry picked from commit 1b53a24)

Co-authored-by: Victor Stinner <[email protected]>

(cherry picked from commit 01659ca)

Co-authored-by: Ned Deily <[email protected]>

(cherry picked from commit 3bbb6db)

Co-authored-by: Kyle Stanley <[email protected]>

These are valid even in python 2.7

https://bugs.python.org/issue33348

Automerge-Triggered-By: @gpshead
(cherry picked from commit 96b06ae)

Co-authored-by: Zsolt Dollenstein <[email protected]>

numbers's -> number's
(cherry picked from commit 7320ec0)

Co-authored-by: Hansraj Das <[email protected]>

(cherry picked from commit cb2cf06)

Co-authored-by: Ammar Askar <[email protected]>

… decorators. (GH-16861)

(cherry picked from commit 26ae9f6)

Co-authored-by: Serhiy Storchaka <[email protected]>

(cherry picked from commit d898d20)

Co-authored-by: Serhiy Storchaka <[email protected]>

(cherry picked from commit 894e30c)

Co-authored-by: Steve Dower <[email protected]>

(cherry picked from commit e3f90b2)

Co-authored-by: Terry Jan Reedy <[email protected]>

(cherry picked from commit e31a79a)

Co-authored-by: Terry Jan Reedy <[email protected]>

…H-16937)

Test by Daniel Hillier.
(cherry picked from commit 5c32af7)

Co-authored-by: Serhiy Storchaka <[email protected]>

)


(cherry picked from commit 85c6f8c)
Co-authored-by: Marco Rougeth <[email protected]>

(cherry picked from commit edb172a)

Co-authored-by: Zackery Spytz <[email protected]>

(cherry picked from commit 794616f)

Co-authored-by: benedwards14 <[email protected]>

…C drive (GH-16968)

(cherry picked from commit 0ac6137)

Co-authored-by: Steve Dower <[email protected]>

(cherry picked from commit 457306b)

Co-authored-by: Kyle Stanley <[email protected]>

…data. (GH-14656)

(cherry picked from commit da6ce58)

Co-authored-by: Daniel Hillier <[email protected]>

Update open() documentation.

…6992)

(cherry picked from commit 6c3e66a)

Co-authored-by: Pablo Galindo <[email protected]>

…n. (GH-16950) (GH-16999)

Replace all *NULL* with ``NULL``.
(cherry picked from commit 25fc088)

Also fix some other formatting.
(cherry picked from commit e835b31)

Change the url from docs.python-requests.org to requests.readthedocs.io
(cherry picked from commit 112f2b8)

Co-authored-by: Simon Legner <[email protected]>

(cherry picked from commit 65c7382)

Co-authored-by: MaT1g3R <[email protected]>

…H-16799) (GH-17016)

(cherry picked from commit 79d4ed1)

* Add missing test class (mistake in GH-4455)

* Increase coverage with 4 more test cases

* Rename neg_uid to huge_uid in test_modified_uid_huge

* Replace test_main() with unittest.main()

* Update plistlib docs.
(cherry picked from commit d0d9f7c)

Co-authored-by: Jon Janzen <[email protected]>

Whenever I use `path.suffix` I have to check again whether it includes the dot or not. I decided to add it to the docstring so I won't have to keep checking.

https://bugs.python.org/issue38422

Automerge-Triggered-By: @pitrou
(cherry picked from commit 8d4fef4)

Co-authored-by: Ram Rachum <[email protected]>

(cherry picked from commit d0e0f5b)

Co-authored-by: Dima Tisnek <[email protected]>

(cherry picked from commit 1cdadf4)

Co-authored-by: Raymond Hettinger <[email protected]>

s/pathing/patching/
(cherry picked from commit 25fa3ec)

Co-authored-by: Michael Haas <[email protected]>

…acros in ``pythonrun.h``. (GH-17056)

(cherry picked from commit 62161ce)

Co-authored-by: Benjamin Peterson <[email protected]>

(cherry picked from commit 99b7701)

Co-authored-by: Борис Верховский <[email protected]>

GH-17026)

This was never intented to be called manually from PyInit_*.

Also, clarify PyState_RemoveModule return value.
(cherry picked from commit 9bc94ec)


Co-authored-by: Petr Viktorin <[email protected]>


https://bugs.python.org/issue38159



Automerge-Triggered-By: @encukou

Fixed what seemed to be a weird phrasing.

(cherry picked from commit 5e01a65)

Co-authored-by: Jules Lasne (jlasne) <[email protected]>

…7043)

(cherry picked from commit 6552563)

Co-authored-by: Alexandru Ardelean <[email protected]>