]> CyberLeo.Net >> Repos - FreeBSD/FreeBSD.git/log
FreeBSD/FreeBSD.git
4 years agogpioiic: set output after switching to output mode if presetting it failed
Andriy Gapon [Fri, 25 Oct 2019 09:37:54 +0000 (09:37 +0000)]
gpioiic: set output after switching to output mode if presetting it failed

Some controllers cannot preset future output value while the pin is in
input mode.  This adds a fallback for those controllers.  The new code
assumes that a controller reports an error in that case.

For example, all hardware supported by nctgpio behaves in that way.

This is a temporary measure.  In the future we will use
GPIO_PIN_PRESET_LOW / GPIO_PIN_PRESET_HIGH to preset the output either
in hardware, if supported, or in software (e.g., in
gpiobus_pin_setflags).

While here, I extracted common functionality of gpioiic_set{sda,scl} and
gpioiic_get{sda,scl} to gpioiic_setpin and gpioiic_getpin respectively.

MFC after: 2 weeks

4 years agozfs.8: fix a typo in the date
Andriy Gapon [Fri, 25 Oct 2019 09:19:15 +0000 (09:19 +0000)]
zfs.8: fix a typo in the date

Reported by: Trond Endrestøl <trond.endrestol@ximalas.info>
MFC after: 3 days

4 years agobinutils: Fix bugs found by -Wpointer-compare
Brooks Davis [Thu, 24 Oct 2019 22:34:48 +0000 (22:34 +0000)]
binutils: Fix bugs found by -Wpointer-compare

The MIPS bug was introduced by upstream commit 7403cb630, which failed
to account for the additional indirection introduced and also dropped
one of the checks; change it to the standard "NULL-or-empty" check as
used elsewhere in BFD, which is also what upstream now has.

Submitted by: James Clarke <jrtc27@jrtc27.com>
Obtained from: CheriBSD
Sponsored by: DARPA, AFRL
Differential Revision: https://reviews.freebsd.org/D21911

4 years agoCatch up with ACPICA 20191018.
Jung-uk Kim [Thu, 24 Oct 2019 22:33:46 +0000 (22:33 +0000)]
Catch up with ACPICA 20191018.

PR: 241467
XMFC with: r353764

4 years agoGuard reference to x86_hypervisor
Simon J. Gerraty [Thu, 24 Oct 2019 22:26:06 +0000 (22:26 +0000)]
Guard reference to x86_hypervisor

Obviously we only want x86_hypervisor on x86
Guard reference to x86_hypervisor

Obviously we only want x86_hypervisor on x86

4 years agonda(4): Remove unnecessary union and avoid Clang -Wsizeof-array-divwarning
Brooks Davis [Thu, 24 Oct 2019 22:23:53 +0000 (22:23 +0000)]
nda(4): Remove unnecessary union and avoid Clang -Wsizeof-array-divwarning

Clang trunk recently gained this new warning, and complains about the
sizeof(trim->data) / sizeof(struct nvme_dsm_range) expression, since
the left hand side's element type (char) does not match the right hand
side's type. The byte buffer is unnecessary so we can remove it to clean
up the code and fix the warning at the same time.

No functional change.

Submitted by: James Clarke <jrtc27@jrtc27.com>
Reviewed by: imp
Sponsored by: DARPA, AFRL
Differential Revision: https://reviews.freebsd.org/D21912

4 years agofrag6: prevent overwriting initial fragoff=0 packet meta-data.
Bjoern A. Zeeb [Thu, 24 Oct 2019 22:07:45 +0000 (22:07 +0000)]
frag6: prevent overwriting initial fragoff=0 packet meta-data.

When we receive the packet with the first fragmented part (fragoff=0)
we remember the length of the unfragmentable part and the next header
(and should probably also remember ECN) as meta-data on the reassembly
queue.
Someone replying this packet so far could change these 2 (3) values.
While changing the next header seems more severe, for a full size
fragmented UDP packet, for example, adding an extension header to the
unfragmentable part would go unnoticed (as the framented part would be
considered an exact duplicate) but make reassembly fail.
So do not allow updating the meta-data after we have seen the first
fragmented part anymore.

The frag6_20 test case is added which failed before triggering an
ICMPv6 "param prob" due to the check for each queued fragment for
a max-size violation if a fragoff=0 packet was received.

MFC after: 3 weeks
Sponsored by: Netflix

4 years agoUse THREAD_CAN_SLEEP() macro to check if thread can sleep. There is no
Gleb Smirnoff [Thu, 24 Oct 2019 21:55:19 +0000 (21:55 +0000)]
Use THREAD_CAN_SLEEP() macro to check if thread can sleep.  There is no
functional change.

Discussed with: kib

4 years agoAfter the unlink() of one name of a file with multiple links, a
Kirk McKusick [Thu, 24 Oct 2019 21:28:37 +0000 (21:28 +0000)]
After the unlink() of one name of a file with multiple links, a
stat() of one of the remaining names of the file does not show an
updated ctime (inode modification time) until several seconds after
the unlink() completes. The problem only occurs when the filesystem
is running with soft updates enabled. When running with soft updates,
the ctime is not updated until the soft updates background process
has settled all the needed I/O operations.

This commit causes the ctime to be updated immediately during the
unlink(). A side effect of this change is that the ctime is updated
again when soft updates has finished its processing because that
is the time that is correct from the perspective of programs that
look at the disk (like dump). This change does not cause any extra
I/O to be done, it just ensures that stat() updates the ctime before
handing it back.

PR:           241373
Reported by:  Alan Somers
Tested by:    Alan Somers
MFC after:    3 days
Sponsored by: Netflix

4 years agofrag6: handling of overlapping fragments to conform to RFC 8200
Bjoern A. Zeeb [Thu, 24 Oct 2019 20:22:52 +0000 (20:22 +0000)]
frag6: handling of overlapping fragments to conform to RFC 8200

While the comment was updated in r350746, the code was not.
RFC8200 says that unless fragment overlaps are exact (same fragment
twice) not only the current fragment but the entire reassembly queue
for this packet must be silently discarded, which we now do if
fragment offset and fragment length do not match.

Obtained from: jtl
MFC after: 3 weeks
Sponsored by: Netflix
Differential Revision: https://reviews.freebsd.org/D16850

4 years agofrag6 test cases: check more counters, wait for expiry
Bjoern A. Zeeb [Thu, 24 Oct 2019 20:08:33 +0000 (20:08 +0000)]
frag6 test cases:  check more counters, wait for expiry

When done with tests check that both the per-VNET and the global-fragmented-
packets-in-system counters are zero to make sure we do not leak counters or
queue entries.

This implies that for all test cases we either have to check for the ICMPv6
packet sent in case of TLL=0 expiry (if it is sent) or sleep at least long
enough for the TTL to expire for all packets (e.g., fragments where we do not
have the off=0 packet).

This also means that statistics are now updated to include all the expired
packets.

There are cases when we do not check for counters to be zero and this is
when testing VNET teardown to behave properly and not panic, when we are
intentionally leaving fragments in the system.

MFC after: 3 weeks
Sponsored by: Netflix

4 years agoEnsure that the flags indicating IPv4/IPv6 are not changed by failing
Michael Tuexen [Thu, 24 Oct 2019 20:05:10 +0000 (20:05 +0000)]
Ensure that the flags indicating IPv4/IPv6 are not changed by failing
bind() calls. This would lead to inconsistent state resulting in a panic.
A fix for stable/11 was committed in
https://svnweb.freebsd.org/base?view=revision&revision=338986
An accelerated MFC is planned as discussed with emaste@.

Reported by: syzbot+2609a378d89264ff5a42@syzkaller.appspotmail.com
Obtained from: jtl@
MFC after: 1 day
Sponsored by: Netflix, Inc.

4 years agoAdd support for hypervisor check on x86
Simon J. Gerraty [Thu, 24 Oct 2019 20:02:48 +0000 (20:02 +0000)]
Add support for hypervisor check on x86

Add ficl words for isvirtualized
and move ficl inb and outb words to ficl/x86/sysdep.c
so can be shared by i386 and amd64

Reviewed by: imp bdrewery
MFC after: 1 week
Sponsored by: Juniper Networks
Differential Revision: https://reviews.freebsd.org/D22069

4 years agofrag6: export another counter read-only by sysctl
Bjoern A. Zeeb [Thu, 24 Oct 2019 20:00:37 +0000 (20:00 +0000)]
frag6: export another counter read-only by sysctl

Similar to the system global counter also export the per-VNET counter
"frag6_nfragpackets" detailing the current number of fragment packets
in this VNET's reassembly queues.
The read-only counter is helpful for in-VNET statistical monitoring and
for test-cases.

MFC after: 3 weeks
Sponsored by: Netflix

4 years agofrag6: fix counter leak in error case and optimise code
Bjoern A. Zeeb [Thu, 24 Oct 2019 19:57:18 +0000 (19:57 +0000)]
frag6: fix counter leak in error case and optimise code

In case the first fragmented part (off=0) arrives we check for the
maximum packet size for each fragmented part we already queued with the
addition of the unfragmentable part from the first one.

For one we do not have to enter the loop at all if this is the first
fragmented part to arrive, and we can skip the check.

Should we encounter an error case we send an ICMPv6 message for any
fragment exceeding the maximum length limit.  While dequeueing the
original packet and freeing it, statistics were not updated and leaked
both the reassembly queue count for the fragment and the global
fragment count.  Found by code inspection and confirmed by tightening
test cases checking more statistical and system counters.

While here properly wrap a line.

MFC after: 3 weeks
Sponsored by: Netflix

4 years agoAllow loader.efi to identify non-standard boot setup
Simon J. Gerraty [Thu, 24 Oct 2019 19:52:41 +0000 (19:52 +0000)]
Allow loader.efi to identify non-standard boot setup

PATH_BOOTABLE_TOKEN can be set to a non-standard
path that identifies a device as bootable.

Reviewed by: kevans, bcran
Differential Revision:  https://reviews.freebsd.org/D22062

4 years agoInitialize verbosity and debug level from env
Simon J. Gerraty [Thu, 24 Oct 2019 19:50:18 +0000 (19:50 +0000)]
Initialize verbosity and debug level from env

For EFI at least, we can seed the environment
with VE_VERBOSE etc.

Reviewed by: stevek imp
Sponsored by: Juniper Networks
MFC after: 1 week
Differential Revision:  https://reviews.freebsd.org/D22135

4 years agofrag6.c: do not leak packet queue entry in error case
Bjoern A. Zeeb [Thu, 24 Oct 2019 19:47:32 +0000 (19:47 +0000)]
frag6.c: do not leak packet queue entry in error case

When we are checking for the maximum reassembled packet size of the
fragmentable part and run into the error case (packet too big),
we are leaking the packet queue enntry if this was a first fragment
to arrive.
Properly cleanup, removing the queue entry from the bucket, decrementing
counters, and freeing the memory.

MFC after: 3 weeks
Sponsored by: Netflix

4 years agoSoft updates needs to keep an on-disk linked list of inodes that
Kirk McKusick [Thu, 24 Oct 2019 19:47:18 +0000 (19:47 +0000)]
Soft updates needs to keep an on-disk linked list of inodes that
have been unlinked, but are still referenced by open file descriptors.
These inodes cannot be freed until the final file descriptor reference
has been closed. If the system crashes while they are still being
referenced, these inodes and their referenced blocks need to be
freed by fsck. By having them on a linked list with the head pointer
in the superblock, fsck can quickly find and process them rather
than having to check every inode in the filesystem to see if it is
unreferenced.

When updating the head pointer of this list of unlinked inodes in
the superblock, the superblock check-hash was not getting updated.
If the system crashed with the incorrect superblock check-hash, the
superblock would appear to be corrupted. This patch ensures that
the superblock check-hash is updated when updating the head pointer
of the unlinked inodes list.

There is no need to MFC as superblock check hashes first appeared in
13.0.

Tested by:    Peter Holm
Sponsored by: Netflix

4 years agoAdd a tunable to set the pgcache zone's maxcache
Andrew Gallatin [Thu, 24 Oct 2019 18:39:05 +0000 (18:39 +0000)]
Add a tunable to set the pgcache zone's maxcache

When it is set to 0 (the default), a heavy Netflix-style web workload
suffers from heavy lock contention on the vm page free queue called from
vm_page_zone_{import,release}() as the buckets are frequently drained.
When setting the maxcache, this contention goes away.

We should eventually try to autotune this, as well as make this
zone eligable for uma_reclaim().

Reviewed by: alc, markj
Not Objected to by: jeff
Sponsored by: Netflix
Differential Revision: https://reviews.freebsd.org/D22112

4 years agoUse a counter with a random base for explicit IVs in GCM.
John Baldwin [Thu, 24 Oct 2019 18:13:26 +0000 (18:13 +0000)]
Use a counter with a random base for explicit IVs in GCM.

This permits constructing the entire TLS header in ktls_frame() rather
than ktls_seq().  This also matches the approach used by OpenSSL which
uses an incrementing nonce as the explicit IV rather than the sequence
number.

Reviewed by: gallatin
Sponsored by: Netflix
Differential Revision: https://reviews.freebsd.org/D22117

4 years agofrag6: leave a note about upper layer header checks TBD
Bjoern A. Zeeb [Thu, 24 Oct 2019 12:16:15 +0000 (12:16 +0000)]
frag6:  leave a note about upper layer header checks TBD

Per sepcification the upper layer header needs to be within the first
fragment.  The check was not done so far and there is an open review for
related work, so just leave a note as to where to put it.
Move the extraction of frag offset up to this as it is needed to determine
whether this is a first fragment or not.

MFC after: 3 weeks
Sponsored by: Netflix

4 years agofrag6: check global limits before hash and lock
Bjoern A. Zeeb [Thu, 24 Oct 2019 11:58:24 +0000 (11:58 +0000)]
frag6: check global limits before hash and lock

Check whether we are accepting more fragments (based on global limits)
before doing expensive operations of calculating the hash and taking the
bucket lock.   This slightly increases a "race" between check time and
incrementing counters (which is already there) possibly allowing a few
more fragments than the maximum limits.  However, when under attack,
we rather save this CPU time for other packets/work.

MFC after: 3 weeks
Sponsored by: Netflix

4 years agoStore a handle for the event handler. This will be used when unloading the
Michael Tuexen [Thu, 24 Oct 2019 09:22:23 +0000 (09:22 +0000)]
Store a handle for the event handler. This will be used when unloading the
SCTP as a module.

Obtained from: markj@

4 years agofrag6: small improvements
Bjoern A. Zeeb [Thu, 24 Oct 2019 08:15:40 +0000 (08:15 +0000)]
frag6: small improvements

Rather than walking the mbuf chain manually use m_last() which doing
exactly that for us.
Defer initializing srcifp for longer as there are multiple exit paths
out of the function which do not need it set.  Initialize before taking
the lock though.
Rename the mtx lock to match the type better.

MFC after: 3 weeks
Sponsored by: Netflix

4 years agofrag6: remove IP6_REASS_MBUF macro
Bjoern A. Zeeb [Thu, 24 Oct 2019 07:53:10 +0000 (07:53 +0000)]
frag6: remove IP6_REASS_MBUF macro

The IP6_REASS_MBUF() macro did some pointer gynmastics to end up with the
same type as it gets in [*(cast **)&].  Spelling it out instead saves all
this and makes the code more readable and less obfuscated directly using
the structure field.

MFC after: 3 weeks
Sponsored by: Netflix

4 years agouserboot/test should use PRIx64 as one would expect from prefix 0x
Toomas Soome [Thu, 24 Oct 2019 07:49:33 +0000 (07:49 +0000)]
userboot/test should use PRIx64 as one would expect from prefix 0x

Test is printing decimal value after prefix 0x.

4 years agoFix a small bug in bbr when running under a VM. Basically what
Randall Stewart [Thu, 24 Oct 2019 05:54:30 +0000 (05:54 +0000)]
Fix a small bug in bbr when running under a VM. Basically what
happens is we are more delayed in the pacer calling in so
we remove the stack from the pacer and recalculate how
much time is left after all data has been acknowledged. However
the comparision was backwards so we end up with a negative
value in the last_pacing_delay time which causes us to
add in a huge value to the next pacing time thus stalling
the connection.

Reported by: vm2.finance@gmail.com

4 years agopowerpc/booke: Simplify the MPC85XX PCIe root complex driver
Justin Hibbits [Thu, 24 Oct 2019 03:51:33 +0000 (03:51 +0000)]
powerpc/booke: Simplify the MPC85XX PCIe root complex driver

Summary:
Due to bugs in the enumeration code, fsl_pcib_init() was not configuring
sub-bridges properly, so devices hanging off a separate bridge would not
be found.  Since the generic PCI code already supports probing child
buses, just delete this code and initialize only the device itself,
letting the generic code handle all the additional probing and
initializing.

This also deletes setup for some PCI peripherals found on some MPC85XX
evaluation boards.  The code can be resurrected if needed, but overly
complicated this code in the first place.

Reviewed by: bdragon
Differential Revision: https://reviews.freebsd.org/D22050

4 years agoiflib: call ether_ifdetach and netmap_detach before stop
Eric Joyner [Wed, 23 Oct 2019 23:20:49 +0000 (23:20 +0000)]
iflib: call ether_ifdetach and netmap_detach before stop

From Jake:
Calling ether_ifdetach after iflib_stop leads to a potential race where
a stale ifp pointer can remain in the route entry list for IPv6 traffic.
This will potentially cause a page fault or other system instability if
the ifp pointer is accessed.

Move both iflib_netmap_detach and ether_ifdetach to be called prior to
iflib_stop. This avoids the race above, and helps ensure that other ifp
references are removed before stopping the interface.

Submitted by: Jacob Keller <jacob.e.keller@intel.com>
Reviewed by: erj@, gallatin@, jhb@
MFC after: 3 days
Sponsored by: Intel Corporation
Differential Revision: https://reviews.freebsd.org/D22071

4 years agofrag6: add "big picture"
Bjoern A. Zeeb [Wed, 23 Oct 2019 23:10:12 +0000 (23:10 +0000)]
frag6: add "big picture"

Add some ASCII relation of how the bits plug together.  The terminology
difference of "fragmented packets" and "fragment packets" is subtle.
While here clear up more whitespace and comments.

No functional change.

MFC after: 3 weeks
Sponsored by: Netflix

4 years agofrag6: replace KAME hand-rolled queues with queue(9) TAILQs
Bjoern A. Zeeb [Wed, 23 Oct 2019 23:01:18 +0000 (23:01 +0000)]
frag6: replace KAME hand-rolled queues with queue(9) TAILQs

Remove the KAME custom circular queue for fragments and fragmented packets
and replace them with a standard TAILQ.
This make the code a lot more understandable and maintainable and removes
further hand-rolled code from the the tree using a standard interface instead.

Hide the still public structures under #ifdef _KERNEL as there is no
use for them in user space.
The naming is a bit confusing now as struct ip6q and the ip6q[] buckets
array are not the same anymore;  sadly struct ip6q is also used by the
MAC framework and we cannot rename it.

Submitted by: jtl (initally)
MFC after: 3 weeks
Sponsored by: Netflix
Differential Revision: https://reviews.freebsd.org/D16847 (jtl's original)

4 years agoModify release_page() to handle a missing fault page.
Mark Johnston [Wed, 23 Oct 2019 20:39:21 +0000 (20:39 +0000)]
Modify release_page() to handle a missing fault page.

r353890 introduced a case where we may call release_page() with
fs.m == NULL, since the fault handler may now lock the vnode prior
to allocating a page for a page-in.

Reported by: jhb
Reviewed by: kib
MFC with: r353890
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D22120

4 years agofrag6: whitespace changes
Bjoern A. Zeeb [Wed, 23 Oct 2019 20:37:15 +0000 (20:37 +0000)]
frag6: whitespace changes

Remove trailing white space, add a blank line, and compress a comment.
No functional changes.

MFC after: 10 days
Sponsored by: Netflix

4 years agoarm64: enable options NUMA in GENERIC
Ed Maste [Wed, 23 Oct 2019 19:35:26 +0000 (19:35 +0000)]
arm64: enable options NUMA in GENERIC

As with amd64 NUMA is required for reasonable operation on big-iron
arm64 systems and is expected to have no significant impact on small
systems.  Enable it now for wider testing in advance of FreeBSD 13.0.

You can use the 'vm.ndomains' sysctl to see if multiple domains are in
use - for example (from Cavium/Marvell ThunderX2):

# sysctl vm.ndomains
vm.ndomains: 2

No objection: manu
Sponsored by: The FreeBSD Foundation

4 years agoexit requires stdlib.h to be included to use.
Warner Losh [Wed, 23 Oct 2019 19:23:31 +0000 (19:23 +0000)]
exit requires stdlib.h to be included to use.

FreeBSD 10.3 requires this, and dtc is a bootstrap tool so it needs to compile
there.

4 years agoamd64 pmap: per-domain pv chunk list
Mateusz Guzik [Wed, 23 Oct 2019 19:17:10 +0000 (19:17 +0000)]
amd64 pmap: per-domain pv chunk list

This significantly reduces contention since chunks get created and removed
all the time. See the review for sample results.

Reviewed by: kib
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D21976

4 years agoamd64: Add CFI directives for libc syscall stubs
Conrad Meyer [Wed, 23 Oct 2019 19:03:03 +0000 (19:03 +0000)]
amd64: Add CFI directives for libc syscall stubs

No functional change (in program code).  Additional DWARF metadata is
generated in the .eh_frame section.  Also, it is now a compile-time
requirement that machine/asm.h ENTRY() and END() macros are paired.  (This
is subject to ongoing discussion and may change.)

This DWARF metadata allows llvm-libunwind to unwind program stacks when the
program is executing the function.  The goal is to collect accurate
userspace stacktraces when programs have entered syscalls.

(The motivation for "Call Frame Information," or CFI for short -- not to be
confused with Control Flow Integrity -- is to sufficiently annotate assembly
functions such that stack unwinders can unwind out of the local frame
without the requirement of a dedicated framepointer register; i.e.,
-fomit-frame-pointer.  This is necessary for C++ exception handling or
collecting backtraces.)

For the curious, a more thorough description of the metadata and some
examples may be found at [1] and documentation at [2].  You can also look at
'cc -S -o - foo.c | less' and search for '.cfi_' to see the CFI directives
generated by your C compiler.

[1]: https://www.imperialviolet.org/2017/01/18/cfi.html
[2]: https://sourceware.org/binutils/docs/as/CFI-directives.html

Reviewed by: emaste, kib (with reservations)
Differential Revision: https://reviews.freebsd.org/D22122

4 years agolibthr: Add missing END() directive for umtx_op_err (amd64)
Conrad Meyer [Wed, 23 Oct 2019 18:27:30 +0000 (18:27 +0000)]
libthr: Add missing END() directive for umtx_op_err (amd64)

Like r353929, related to D22122.  No functional change.

Reviewed by: emaste, kib (earlier version both)

4 years agoCheck for bogus_page in vnode_pager_generic_getpages_done().
Mark Johnston [Wed, 23 Oct 2019 18:00:22 +0000 (18:00 +0000)]
Check for bogus_page in vnode_pager_generic_getpages_done().

We now assert that a page is busy when updating its validity-tracking
state, but bogus_page is not busied during a getpages operation.

Reported by: syzkaller
Reviewed by: alc, kib
Discussed with: jeff
MFC after: 1 week
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D22124

4 years agoVerify identity after checking for WAITFAIL in vm_page_busy_acquire().
Mark Johnston [Wed, 23 Oct 2019 17:58:19 +0000 (17:58 +0000)]
Verify identity after checking for WAITFAIL in vm_page_busy_acquire().

A caller that does not guarantee that a page's identity won't change
while sleeping for a busy lock must specify either NOWAIT or WAITFAIL.

Reported by: syzkaller
Reviewed by: alc, kib
Discussed with: jeff
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D22124

4 years agoAdd missing M_NOWAIT flag
Ryan Stone [Wed, 23 Oct 2019 17:20:20 +0000 (17:20 +0000)]
Add missing M_NOWAIT flag

The LinuxKPI linux_dma code calls PCTRIE_INSERT with a
mutex held, but does not set M_NOWAIT when allocating
nodes, leading to a potential panic.  All of this code
can handle an allocation failure here, so prefer an
allocation failure to sleeping on memory.

Also fix a related case where NOWAIT/WAITOK was not
specified.  In this case it's not clear whether sleeping
is allowed so be conservative and assume not.  There are
a lot of other paths in this code that can fail due to
a lack of memory anyway.

Differential Revision: https://reviews.freebsd.org/D22127
Reviewed by: imp
Sponsored by: Dell EMC Isilon
MFC After: 1 week

4 years agoBuild toolchain components as dynamically linked executables by default
Dimitry Andric [Wed, 23 Oct 2019 17:02:45 +0000 (17:02 +0000)]
Build toolchain components as dynamically linked executables by default

Summary:
Historically, we have built toolchain components such as cc, ld, etc as
statically linked executables.  One of the reasons being that you could
sometimes save yourself from botched upgrades, by e.g. recompiling a
"known good" libc and reinstalling it.

In this day and age, we have boot environments, virtual machine
snapshots, cloud backups, and other much more reliable methods to
restore systems to working order.  So I think the time is ripe to flip
this default, and link the toolchain components dynamically, just like
almost all other executables on FreeBSD.

Maybe at some point they can even become PIE executables by default! :)

Reviewed by: kib
MFC after: 2 weeks
Differential Revision: https://reviews.freebsd.org/D22061

4 years agoBump clang's default target CPU for the i386 architecture (aka "x86") to
Dimitry Andric [Wed, 23 Oct 2019 16:57:11 +0000 (16:57 +0000)]
Bump clang's default target CPU for the i386 architecture (aka "x86") to
i686, as per the discussion on the freebsd-arch mailing list.  Earlier
in r352030, I had already bumped it to i586, to work around missing
atomic 64 bit functions for the i386 architecture.

Relnotes: yes

4 years agoSet OBJ_NOSPLIT on the ksyms(4) VM object.
Mark Johnston [Wed, 23 Oct 2019 16:53:37 +0000 (16:53 +0000)]
Set OBJ_NOSPLIT on the ksyms(4) VM object.

The object does not provide anonymous memory.

Reported by: kib
Reviewed by: kib
MFC after: 3 days
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D22123

4 years agoPrevent a panic when a driver provides bogus debugnet parameters
Conrad Meyer [Wed, 23 Oct 2019 16:48:22 +0000 (16:48 +0000)]
Prevent a panic when a driver provides bogus debugnet parameters

This is just a bandaid; we should fix the driver(s) too.  Introduced in
r353685.

PR: 241403
X-MFC-With: r353685
Reported by: np and others

4 years agoSlightly expand description of WITH_SHARED_TOOLCHAIN, add a
Dimitry Andric [Wed, 23 Oct 2019 16:48:17 +0000 (16:48 +0000)]
Slightly expand description of WITH_SHARED_TOOLCHAIN, add a
corresponding WITHOUT_SHARED_TOOLCHAIN description, and regenerate
src.conf(5).

MFC after:  3 days

4 years agoStrip "sf" suffix when generating a target triple.
John Baldwin [Wed, 23 Oct 2019 16:43:51 +0000 (16:43 +0000)]
Strip "sf" suffix when generating a target triple.

This fixes the target triple used when compiling riscv64sf with clang.

Discussed with: mhorne
MFC after: 2 weeks
Sponsored by: DARPA

4 years agoFix atomic_*cmpset32 on riscv64 with clang.
John Baldwin [Wed, 23 Oct 2019 16:41:31 +0000 (16:41 +0000)]
Fix atomic_*cmpset32 on riscv64 with clang.

The lr.w instruction used to read the value from memory sign-extends
the value read from memory.  GCC sign-extends the 32-bit comparison
value passed in whereas clang currently does not.  As a result, if the
value being compared has the MSB set, the comparison fails for
matching 32-bit values when compiled with clang.

Use a cast to explicitly sign-extend the unsigned comparison value.
This works with both GCC and clang.

There is commentary in the RISC-V spec that suggests that GCC's
approach is more correct, but it is not clear if the commentary in the
RISC-V spec is binding.

Reviewed by: mhorne
Obtained from: Axiado
MFC after: 2 weeks
Sponsored by: DARPA
Differential Revision: https://reviews.freebsd.org/D22084

4 years agoFix undefined behavior.
Konstantin Belousov [Wed, 23 Oct 2019 16:06:47 +0000 (16:06 +0000)]
Fix undefined behavior.

Create a sequence point by ending a full expression for call to
vspace() and use of the globals which are modified by vspace().

Reported and reviewed by: imp
Sponsored by: The FreeBSD Foundation
MFC after: 1 week
Differential revision: https://reviews.freebsd.org/D22126

4 years agolibm: Add missing END() directives for amd64 routines
Conrad Meyer [Wed, 23 Oct 2019 16:05:52 +0000 (16:05 +0000)]
libm: Add missing END() directives for amd64 routines

No functional change.  Related to D22122.

Reviewed by: emaste, kib (earlier version both)

4 years agovn_printf(): Decode VI_TEXT_REF.
Konstantin Belousov [Wed, 23 Oct 2019 15:51:26 +0000 (15:51 +0000)]
vn_printf(): Decode VI_TEXT_REF.

Sponsored by: The FreeBSD Foundation
MFC after: 3 days

4 years agoStop enabling interrupts when reentering kdb on arm64
Andrew Turner [Wed, 23 Oct 2019 13:21:15 +0000 (13:21 +0000)]
Stop enabling interrupts when reentering kdb on arm64

When we raise a data abort from the kernel we need to enable interrupts,
however we shouldn't be doing this when in the kernel debugger. In this
case interrupts can lead to a further panic as they don't expect to be
run from such a context.

MFC after: 2 weeks
Sponsored by: DARPA, AFRL

4 years agoregulator: Add a regnode_set_constraint function
Emmanuel Vadot [Wed, 23 Oct 2019 09:56:53 +0000 (09:56 +0000)]
regulator: Add a regnode_set_constraint function

This method check that boot_on or always_on is set to 1 and if it
is it will try to enable the regulator.
The binding docs aren't clear on what to do but Linux enable the regulator
if any of those properties is set so we want to do the same.
The function first check the status to see if the regulator is
already enabled it then get the voltage to check if it is in a acceptable
range and then enables it.
This will be either called from the regnode_init method (if it's needed by the platform)
or by a SYSINIT at SI_SUB_LAST

Reviewed by: mmel
MFC after: 1 week
Differential Revision: https://reviews.freebsd.org/D22106

4 years agoaxp81x: Use the default regnode_init method
Emmanuel Vadot [Wed, 23 Oct 2019 09:54:50 +0000 (09:54 +0000)]
axp81x: Use the default regnode_init method

MFC after: 1 week

4 years agoregulator: Add a regnode_method_init
Emmanuel Vadot [Wed, 23 Oct 2019 09:54:12 +0000 (09:54 +0000)]
regulator: Add a regnode_method_init

This is a default init method for regulator that don't really
need one.

MFC after: 1 week

4 years agoAssert that vm_fault_lock_vnode() returns locked saved vnode.
Konstantin Belousov [Wed, 23 Oct 2019 07:36:26 +0000 (07:36 +0000)]
Assert that vm_fault_lock_vnode() returns locked saved vnode.

Reviewed by: alc, markj
Sponsored by: The FreeBSD Foundation
MFC after: 2 weeks
Differential revision: https://reviews.freebsd.org/D22113

4 years agocap_sysctl: correct typo from r347534-ish
Kyle Evans [Wed, 23 Oct 2019 03:23:14 +0000 (03:23 +0000)]
cap_sysctl: correct typo from r347534-ish

operation & ~limit where limit is a bool is clearly not what was intended,
given the line prior. Correct it to use the calculated mask for validation.

The cap_sysctl tests should now be functional again.

4 years agotuntap(4): Fix NOINET build after r353741
Kyle Evans [Wed, 23 Oct 2019 02:15:15 +0000 (02:15 +0000)]
tuntap(4): Fix NOINET build after r353741

Shuffle headers around to more appropriate #ifdef OPTION blocks (INET vs.
INET6) -- double checked LINT-{NOINET,NOINET6,NOIP}, all seem good.

Reported by: cem

4 years agolibcasper/services: include <src.opts.mk> to hook tests to build
Kyle Evans [Wed, 23 Oct 2019 01:50:41 +0000 (01:50 +0000)]
libcasper/services: include <src.opts.mk> to hook tests to build

Note that the cap_sysctl tests are currently failing and need some
attention.

4 years agoCorrect spelling, apply appropriate respect.
Greg Lehey [Wed, 23 Oct 2019 01:11:25 +0000 (01:11 +0000)]
Correct spelling, apply appropriate respect.

4 years agopowerpc/booke: Fix Book-E boot post-minidump
Justin Hibbits [Wed, 23 Oct 2019 00:31:19 +0000 (00:31 +0000)]
powerpc/booke: Fix Book-E boot post-minidump

r353489 added minidump support for powerpc64, but it added a dependency on
the dump_avail array.  Leaving it uninitialized caused breakage in late
boot.  Initialize dump_avail, even though the 64-bit booke pmap doesn't yet
support minidumps, but will in the future.

4 years agoBelatedly remove stale debug symbols after r339270.
Jung-uk Kim [Wed, 23 Oct 2019 00:05:29 +0000 (00:05 +0000)]
Belatedly remove stale debug symbols after r339270.

Reported by: danfe
MFC after: 3 days

4 years agoamd64 pmap: conditionalize per-superpage locks on NUMA
Mateusz Guzik [Tue, 22 Oct 2019 22:55:46 +0000 (22:55 +0000)]
amd64 pmap: conditionalize per-superpage locks on NUMA

Instead of superpages use. The current code employs superpage-wide locking
regardless and the better locking granularity is welcome with NUMA enabled
even when superpage support is not used.

Requested by: alc
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D21982

4 years agoamd64 pmap: fixup invlgen lookup for fictitious mappings
Mateusz Guzik [Tue, 22 Oct 2019 22:54:41 +0000 (22:54 +0000)]
amd64 pmap: fixup invlgen lookup for fictitious mappings

Similarly to r353438, use dummy entry.

Reported and tested by: Neel Chauhan
Sponsored by: The FreeBSD Foundation

4 years agopseudofs: hashed vncache
Mateusz Guzik [Tue, 22 Oct 2019 22:52:53 +0000 (22:52 +0000)]
pseudofs: hashed vncache

Vast majority of uses the cache are just checking if there is an entry
present on process exit (and evicting it if so). Both checking and
eviction process are very expensive and put the lock protecting it high
up on the profile during poudriere -j 104.

Convert the linked list into a hash. This allows to almost always avoid
taking the lock in the first place (and consequently almost removes it
from the profile). Note only one lock is preserved as a split did not
meaningfully impact contention.

Should the cache be used for something it will still run into contention
issues. The code needs a rewrite, but should someone want to tidy it up
further the following can be done:

1) per-chain locks (or at least an array)
2) hashing by something else than just pid

Sponsored by: The FreeBSD Foundation

4 years agoReplace an uninitialized variable with the correct element from the
Kirk McKusick [Tue, 22 Oct 2019 22:23:59 +0000 (22:23 +0000)]
Replace an uninitialized variable with the correct element from the
superblock when doing recovery with journalled soft updates.

Reported by:  Chuck Silvers
MFC after:    3 days
Sponsored by: Netflix

4 years agoarm: correct kernelstack allocation size
Kyle Evans [Tue, 22 Oct 2019 21:46:03 +0000 (21:46 +0000)]
arm: correct kernelstack allocation size

This appears to be a copy-pasto from previous lines that propagated to v6
over the years. Indeed, nothing references kernelstack beyond
USPACE_SVC_STACK_TOP and it would be odd if anything did.

Noticed by: markj

4 years agoSplit Chelsio send tags into a generic base tag and a ratelimit tag.
John Baldwin [Tue, 22 Oct 2019 20:41:54 +0000 (20:41 +0000)]
Split Chelsio send tags into a generic base tag and a ratelimit tag.

NIC KTLS will add a new TLS send tag type in cxgbe(4) that is a
distinct tag from a ratelimit tag.  To support this, refactor
cxgbe_snd_tag to be a simple send tag with a type and convert the
existing ratelimit tag to a new cxgbe_rate_tag structure.

Reviewed by: np
Sponsored by: Chelsio Communications
Differential Revision: https://reviews.freebsd.org/D22072

4 years agoAlways allocate the atid table during attach.
John Baldwin [Tue, 22 Oct 2019 20:01:47 +0000 (20:01 +0000)]
Always allocate the atid table during attach.

Previously the table was allocated on first use by TOE and the
ratelimit code.  The forthcoming NIC KTLS code also uses this table.
Allocate it unconditionally during attach to simplify consumers.

Reviewed by: np
Differential Revision: https://reviews.freebsd.org/D22028

4 years agoblacklistd: remove reference to NetBSD npfctl
Ed Maste [Tue, 22 Oct 2019 18:30:51 +0000 (18:30 +0000)]
blacklistd: remove reference to NetBSD npfctl

Xr pfctl instead.

PR: 221069
Submitted by: "fml"
MFC after: 3 days

4 years ago[PPC] Avoid underflows in NUMA domains
Leandro Lupori [Tue, 22 Oct 2019 18:28:58 +0000 (18:28 +0000)]
[PPC] Avoid underflows in NUMA domains

On POWER8 systems with only one memory domain, the "ibm,associativity"
number that corresponds to it is 0, unlike POWER9 systems with two
or more domains, in which the minimum value is 1.

In POWER8 case, subtracting 1 causes an underflow on the unsigned domain
variable and a subsequent index out-of-bounds access.

Reviewed by: jhibbits
Tested by: bdragon, luporl

4 years agoAllow epoch tracker to use the very last byte of the stack. Not sure
Gleb Smirnoff [Tue, 22 Oct 2019 18:05:15 +0000 (18:05 +0000)]
Allow epoch tracker to use the very last byte of the stack.  Not sure
this will help to avoid panic in this function, since it will also use
some stack, but makes code more strict.

Submitted by: hselasky

4 years agoApply r353893 to arm64.
Mark Johnston [Tue, 22 Oct 2019 17:22:10 +0000 (17:22 +0000)]
Apply r353893 to arm64.

Reported by: Jenkins (hardware CI lab)
MFC after: 1 week
Sponsored by: The FreeBSD Foundation

4 years agoInitialize thread0.td_kstack_pages on arm.
Mark Johnston [Tue, 22 Oct 2019 17:21:23 +0000 (17:21 +0000)]
Initialize thread0.td_kstack_pages on arm.

Fix style on the line below.

Reported by: Jenkins (hardware CI lab)
MFC after: 1 week
Sponsored by: The FreeBSD Foundation

4 years agoFix thread0 kernel stack initialization on riscv.
Mark Johnston [Tue, 22 Oct 2019 16:52:56 +0000 (16:52 +0000)]
Fix thread0 kernel stack initialization on riscv.

- td_kstack_pages was not being initialized.
- td_kstack is supposed to be the base address of the stack region,
  not the top.

The arm ports seem to have similar problems and will be fixed next.

Reported by: Jenkins via lwhsu
MFC after: 1 week
Sponsored by: The FreeBSD Foundation

4 years agoAssert that vnode_pager_setsize() is called with the vnode exclusively locked
Konstantin Belousov [Tue, 22 Oct 2019 16:21:24 +0000 (16:21 +0000)]
Assert that vnode_pager_setsize() is called with the vnode exclusively locked

except for filesystems that set the MNTK_VMSETSIZE_BUG,  Set the flag for ZFS.

Tested by: pho
Sponsored by: The FreeBSD Foundation
MFC after: 2 weeks
Differential revision: https://reviews.freebsd.org/D21883

4 years agoFix interface between nfsclient and vnode pager.
Konstantin Belousov [Tue, 22 Oct 2019 16:17:38 +0000 (16:17 +0000)]
Fix interface between nfsclient and vnode pager.

Make the nfsclient always call vnode_pager_setsize() with the vnode
exclusively locked.  This ensures that page fault always can find the
backing page if the object size check succeeded.  Set VV_VMSIZEVNLOCK
flag on NFS nodes.

The main offender breaking the interface in nfsclient is
nfs_loadattrcache(), which is used whenever server responded with
updated attributes, which can happen on non-changing operations as
well.  Also, iod threads only have buffers locked (and even that is
LK_KERNPROC), but they still may call nfs_loadattrcache() on RPC
response.

Instead of immediately calling vnode_pager_setsize() if server
response indicated changed file size, but the vnode is not exclusively
locked, set a new node flag NVNSETSZSKIP.  When the vnode exclusively
locked, or when we can temporary upgrade the lock to exclusive, call
vnode_pager_setsize(), by providing the nfsclient VOP_LOCK() implementation.

Tested by: pho
Discussed with: rmacklem
Sponsored by: The FreeBSD Foundation
MFC after: 2 weeks
Differential revision: https://reviews.freebsd.org/D21883

4 years agoAdd VV_VMSIZEVNLOCK flag.
Konstantin Belousov [Tue, 22 Oct 2019 16:09:25 +0000 (16:09 +0000)]
Add VV_VMSIZEVNLOCK flag.

The flag specifies that vm_fault() handler should check the vnode'
vm_object size under the vnode lock.  It is converted into the object'
OBJ_SIZEVNLOCK flag in vnode_pager_alloc().

Tested by: pho
Reviewed by: markj
Sponsored by: The FreeBSD Foundation
MFC after: 2 weeks
Differential revision: https://reviews.freebsd.org/D21883

4 years agoExecute nd6_dad_timer() in the network epoch, since nd6_dad_duplicated()
Gleb Smirnoff [Tue, 22 Oct 2019 16:06:33 +0000 (16:06 +0000)]
Execute nd6_dad_timer() in the network epoch, since nd6_dad_duplicated()
requires it.
Make nd6_dad_starttimer() require network epoch.  Two calls out of three
happen from nd6_dad_timer().  Enter epoch in the remaining one.

4 years agovm_fault(): extract code to lock the vnode into a helper vn_fault_lock_vnode().
Konstantin Belousov [Tue, 22 Oct 2019 15:59:16 +0000 (15:59 +0000)]
vm_fault(): extract code to lock the vnode into a helper vn_fault_lock_vnode().

Tested by: pho
Reviewed by: markj
Sponsored by: The FreeBSD Foundation
MFC after: 2 weeks
Differential revision: https://reviews.freebsd.org/D21883

4 years agonctgpio: improve performance (latency) of operation
Andriy Gapon [Tue, 22 Oct 2019 14:20:35 +0000 (14:20 +0000)]
nctgpio: improve performance (latency) of operation

This change consists of two parts.

First, nctgpio now supports hardware access via an I/O port window if
it's configured by firmware.  For instance, PC Engines firmware
v4.10.0.2 does that.  This is faster than going through the Super I/O
configuration registers.

Second, nctgpio now caches values of bits that it controls.  For
example, the driver does not need to access the hardware to determine if
a pin is an output or an input, or a state of an output.  Also, the
driver makes use of the fact that the hardware preserves an output state
of a pin accross a switch to the input mode and back.

With this change I am able to use the 1-Wire bus over nctgpio whereas
previously the driver introduced too much latency to be compliant with
the relatively strict protocol timings.

superio0: <Nuvoton NCT5104D/NCT6102D/NCT6106D (rev. B+)> at port 0x2e-0x2f on isa0
gpio1: <Nuvoton GPIO controller> at GPIO ldn 0x07 on superio0
pcib0: allocated type 4 (0x220-0x226) for rid 0 of gpio1
gpiobus1: <GPIO bus> on gpio1
owc0: <GPIO attached one-wire bus> at pin 4 on gpiobus1
ow0: <1 Wire Bus> on owc0
ow0: romid 28:b2:9e:45:92:10:02:34: no driver
ow_temp0: <Advanced One Wire Temperature> romid 28:b2:9e:45:92:10:02:34 on ow0

MFC after: 4 weeks

4 years agoAvoid reloading bucket pointers in uma_vm_zone_stats().
Mark Johnston [Tue, 22 Oct 2019 14:20:06 +0000 (14:20 +0000)]
Avoid reloading bucket pointers in uma_vm_zone_stats().

The correctness of per-CPU cache accounting in that function is
dependent on reading per-CPU pointers exactly once.  Ensure that
the compiler does not emit multiple loads of those pointers.

Reported and tested by: pho
Reviewed by: kib
MFC after: 1 week
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D22081

4 years agotuntap(4): properly declare if_tun and if_tap modules
Kyle Evans [Tue, 22 Oct 2019 00:18:16 +0000 (00:18 +0000)]
tuntap(4): properly declare if_tun and if_tap modules

Simply adding MODULE_VERSION does not do the trick, because the modules
haven't been declared. This should actually fix modfind/kldstat, which
r351229 aimed and failed to do.

This should make vm-bhyve do the right thing again when using the ports
version, rather than the latest version not in ports.

MFC after: 3 days

4 years agoAssert that any epoch tracker belongs to the thread stack.
Gleb Smirnoff [Mon, 21 Oct 2019 23:12:14 +0000 (23:12 +0000)]
Assert that any epoch tracker belongs to the thread stack.

Reviewed by: kib

4 years agoUpdate tcsh to git revision 83c5be0 bringing in a number of bug fixes.
Brooks Davis [Mon, 21 Oct 2019 21:21:34 +0000 (21:21 +0000)]
Update tcsh to git revision 83c5be0 bringing in a number of bug fixes.

Reported by: sobomax
MFC after: 3 days
Sponsored by: DARPA, AFRL
Differential Revision: https://reviews.freebsd.org/D22099

4 years agoif_tuntap: remove if_{tun,tap}.ko -> if_tuntap.ko links
Kyle Evans [Mon, 21 Oct 2019 20:28:38 +0000 (20:28 +0000)]
if_tuntap: remove if_{tun,tap}.ko -> if_tuntap.ko links

These drivers have been merged into a single if_tuntap in 13.0. The
compatibility links existed only for the interim and will be MFC'd along
with the if_tuntap merge shortly.

MFC after: never

4 years agolualoader: fix setting of loader_color=NO in loader.conf(5)
Kyle Evans [Mon, 21 Oct 2019 20:17:31 +0000 (20:17 +0000)]
lualoader: fix setting of loader_color=NO in loader.conf(5)

Previously color.disabled would be calculated at color module load time,
then never touched again. We can detect serial boots beyond just what we're
told by loader.conf(5) so this works out in many cases, but we must
re-evaluate the situation after the config is loaded to make sure we're not
supposed to be forcing it enabled/disabled.

Discovered while trying to test r353872.

4 years agolualoader: don't botch disabling of color
Kyle Evans [Mon, 21 Oct 2019 20:09:43 +0000 (20:09 +0000)]
lualoader: don't botch disabling of color

When colors are disabled, color.escape{fg,bg} would return the passed in
color rather than the proper ANSI sequence for the color.
color.escape{fg,bg} would be wrong.

Instead return '', as the associated reset* functions will also return ''.
This should get rid of the funky '2' and '4' in the kernel selector if
you're booting serial.

Reported by: npn

4 years agoAdditional fix for -DNO_CLEAN build across r353340 and r353381
Ed Maste [Mon, 21 Oct 2019 18:40:03 +0000 (18:40 +0000)]
Additional fix for -DNO_CLEAN build across r353340 and r353381

opensolaris_atomic.S is now only used on i386 with opensolaris_atomic.c
used on other platforms.  After r353381 it doesn't exist on those
platforms so the stale dependency would result in a build error.

r353408 addressed this issue for cddl/lib/libzpool, but it persisted
with the opensolaris and zfs modules.

4 years agoRemove epoch tracker from struct thread. It was an ugly crutch to emulate
Gleb Smirnoff [Mon, 21 Oct 2019 18:19:32 +0000 (18:19 +0000)]
Remove epoch tracker from struct thread.  It was an ugly crutch to emulate
locking semantics for if_addr_rlock() and if_maddr_rlock().

4 years agoRemove obsoleted KPIs that were used to access interface address lists.
Gleb Smirnoff [Mon, 21 Oct 2019 18:17:03 +0000 (18:17 +0000)]
Remove obsoleted KPIs that were used to access interface address lists.

4 years agoConvert to if_foreach_llmaddr() KPI.
Gleb Smirnoff [Mon, 21 Oct 2019 18:13:37 +0000 (18:13 +0000)]
Convert to if_foreach_llmaddr() KPI.

4 years agoConvert to if_foreach_llmaddr() KPI.
Gleb Smirnoff [Mon, 21 Oct 2019 18:13:33 +0000 (18:13 +0000)]
Convert to if_foreach_llmaddr() KPI.

4 years agoConvert to if_foreach_llmaddr() KPI.
Gleb Smirnoff [Mon, 21 Oct 2019 18:13:28 +0000 (18:13 +0000)]
Convert to if_foreach_llmaddr() KPI.

4 years agoConvert to if_foreach_llmaddr() KPI.
Gleb Smirnoff [Mon, 21 Oct 2019 18:13:24 +0000 (18:13 +0000)]
Convert to if_foreach_llmaddr() KPI.

4 years agoConvert to if_foreach_llmaddr() KPI.
Gleb Smirnoff [Mon, 21 Oct 2019 18:13:19 +0000 (18:13 +0000)]
Convert to if_foreach_llmaddr() KPI.

4 years agoConvert to if_foreach_llmaddr() KPI.
Gleb Smirnoff [Mon, 21 Oct 2019 18:13:14 +0000 (18:13 +0000)]
Convert to if_foreach_llmaddr() KPI.

4 years agoConvert to if_foreach_llmaddr() KPI.
Gleb Smirnoff [Mon, 21 Oct 2019 18:12:58 +0000 (18:12 +0000)]
Convert to if_foreach_llmaddr() KPI.

4 years agoConvert to if_foreach_llmaddr() KPI.
Gleb Smirnoff [Mon, 21 Oct 2019 18:12:40 +0000 (18:12 +0000)]
Convert to if_foreach_llmaddr() KPI.