1 .\" Copyright (c) 2002, 2003 Hiten M. Pandya.
2 .\" All rights reserved.
4 .\" Redistribution and use in source and binary forms, with or without
5 .\" modification, are permitted provided that the following conditions
7 .\" 1. Redistributions of source code must retain the above copyright
8 .\" notice, this list of conditions, and the following disclaimer,
9 .\" without modification, immediately at the beginning of the file.
10 .\" 2. The name of the author may not be used to endorse or promote products
11 .\" derived from this software without specific prior written permission.
13 .\" THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND
14 .\" ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
15 .\" IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
16 .\" ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR, CONTRIBUTORS OR THE
17 .\" VOICES IN HITEN PANDYA'S HEAD BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
18 .\" SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED
19 .\" TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
20 .\" PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF
21 .\" LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING
22 .\" NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
23 .\" SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
25 .\" Copyright (c) 1996, 1997, 1998, 2001 The NetBSD Foundation, Inc.
26 .\" All rights reserved.
28 .\" This code is derived from software contributed to The NetBSD Foundation
29 .\" by Jason R. Thorpe of the Numerical Aerospace Simulation Facility,
30 .\" NASA Ames Research Center.
32 .\" Redistribution and use in source and binary forms, with or without
33 .\" modification, are permitted provided that the following conditions
35 .\" 1. Redistributions of source code must retain the above copyright
36 .\" notice, this list of conditions and the following disclaimer.
37 .\" 2. Redistributions in binary form must reproduce the above copyright
38 .\" notice, this list of conditions and the following disclaimer in the
39 .\" documentation and/or other materials provided with the distribution.
40 .\" 3. All advertising materials mentioning features or use of this software
41 .\" must display the following acknowledgment:
42 .\" This product includes software developed by the NetBSD
43 .\" Foundation, Inc. and its contributors.
44 .\" 4. Neither the name of The NetBSD Foundation nor the names of its
45 .\" contributors may be used to endorse or promote products derived
46 .\" from this software without specific prior written permission.
48 .\" THIS SOFTWARE IS PROVIDED BY THE NETBSD FOUNDATION, INC. AND CONTRIBUTORS
49 .\" ``AS IS'' AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED
50 .\" TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
51 .\" PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE FOUNDATION OR CONTRIBUTORS
52 .\" BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
53 .\" CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
54 .\" SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
55 .\" INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
56 .\" CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
57 .\" ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
58 .\" POSSIBILITY OF SUCH DAMAGE.
61 .\" $NetBSD: bus_dma.9,v 1.25 2002/10/14 13:43:16 wiz Exp $
68 .Nm bus_dma_tag_create ,
69 .Nm bus_dma_tag_destroy ,
70 .Nm bus_dmamap_create ,
71 .Nm bus_dmamap_destroy ,
73 .Nm bus_dmamap_load_mbuf ,
74 .Nm bus_dmamap_load_uio ,
75 .Nm bus_dmamap_unload ,
77 .Nm bus_dmamem_alloc ,
79 .Nd Bus and Machine Independent DMA Mapping Interface
83 .Fn bus_dma_tag_create "bus_dma_tag_t parent" "bus_size_t alignment" \
84 "bus_size_t boundary" "bus_addr_t lowaddr" "bus_addr_t highaddr" \
85 "bus_dma_filter_t *filtfunc" "void *filtfuncarg" "bus_size_t maxsize" \
86 "int nsegments" "bus_size_t maxsegsz" "int flags" "bus_dma_lock_t *lockfunc" \
87 "void *lockfuncarg" "bus_dma_tag_t *dmat"
89 .Fn bus_dma_tag_destroy "bus_dma_tag_t dmat"
91 .Fn bus_dmamap_create "bus_dma_tag_t dmat" "int flags" "bus_dmamap_t *mapp"
93 .Fn bus_dmamap_destroy "bus_dma_tag_t dmat" "bus_dmamap_t map"
95 .Fn bus_dmamap_load "bus_dma_tag_t dmat" "bus_dmamap_t map" "void *buf" \
96 "bus_size_t buflen" "bus_dmamap_callback_t *callback" "void *callback_arg" \
99 .Fn bus_dmamap_load_mbuf "bus_dma_tag_t dmat" "bus_dmamap_t map" \
100 "struct mbuf *mbuf" "bus_dmamap_callback2_t *callback" "void *callback_arg" \
103 .Fn bus_dmamap_load_uio "bus_dma_tag_t dmat" "bus_dmamap_t map" \
104 "struct uio *uio" "bus_dmamap_callback2_t *callback" "void *callback_arg" \
107 .Fn bus_dmamem_alloc "bus_dma_tag_t dmat" "void **vaddr" \
108 "int flags" "bus_dmamap_t *mapp"
110 .Fn bus_dmamap_unload "bus_dma_tag_t dmat" "bus_dmamap_t map"
112 .Fn bus_dmamap_sync "bus_dma_tag_t dmat" "bus_dmamap_t map" \
115 .Fn bus_dmamem_free "bus_dma_tag_t dmat" "void *vaddr" \
118 Direct Memory Access (DMA) is a method of transferring data
119 without involving the CPU, thus providing higher performance.
120 A DMA transaction can be achieved between device to memory,
121 device to device, or memory to memory.
125 API is a bus, device, and machine-independent (MI) interface to
127 It provides the client with flexibility and simplicity by
128 abstracting machine dependent issues like setting up
129 DMA mappings, handling cache issues, bus specific features
131 .Sh STRUCTURES AND TYPES
132 .Bl -tag -width compact
134 A machine-dependent (MD) opaque type that describes the
135 characteristics of DMA transactions.
136 DMA tags are organized into a hierarchy, with each child
137 tag inheriting the restrictions of its parent.
138 This allows all devices along the path of DMA transactions
139 to contribute to the constraints of those transactions.
140 .It Vt bus_dma_filter_t
141 Client specified address filter having the format:
142 .Bl -tag -width compact
144 .Fn "client_filter" "void *filtarg" "bus_addr_t testaddr"
147 Address filters can be specified during tag creation to allow
148 for devices who's DMA address restrictions cannot be specified
152 is client specified during tag creation to be passed to all
153 invocations of the callback.
156 argument contains a potential starting address of a DMA mapping.
157 The filter function operates on the set of addresses from
160 .Ql trunc_page(testaddr) + PAGE_SIZE - 1 ,
162 The filter function should return zero for any mapping in this range
163 that can be accommodated by the device and non-zero otherwise.
164 .It Vt bus_dma_segment_t
165 A machine-dependent type that describes individual
174 field contains the device visible address of the DMA segment, and
176 contains the length of the DMA segment.
177 Although the DMA segments returned by a mapping call will adhere to
178 all restrictions necessary for a successful DMA operation, some conversion
179 (e.g.\& a conversion from host byte order to the device's byte order) is
180 almost always required when presenting segment information to the device.
182 A machine-dependent opaque type describing an individual mapping.
183 Multiple DMA maps can be associated with one DMA tag.
184 .It Vt bus_dmamap_callback_t
185 Client specified callback for receiving mapping information resulting from
189 .Fn bus_dmamap_load .
190 Callbacks are of the format:
191 .Bl -tag -width compact
193 .Fn "client_callback" "void *callback_arg" "bus_dma_segment_t *segs" \
194 "int nseg" "int error"
199 is the callback argument passed to dmamap load functions.
204 parameters describe an array of
205 .Vt bus_dma_segment_t
206 structures that represent the mapping.
207 This array is only valid within the scope of the callback function.
208 The success or failure of the mapping is indicated by the
211 More information on the use of callbacks can be found in the
212 description of the individual dmamap load functions.
213 .It Vt bus_dmamap_callback2_t
214 Client specified callback for receiving mapping information resulting from
218 .Fn bus_dmamap_load_uio
220 .Fn bus_dmamap_load_mbuf .
222 Callback2s are of the format:
223 .Bl -tag -width compact
225 .Fn "client_callback2" "void *callback_arg" "bus_dma_segment_t *segs" \
226 "int nseg" "bus_size_t mapsize" "int error"
229 Callback2's behavior is the same as
230 .Vt bus_dmamap_callback_t
231 with the addition that the length of the data mapped is provided via
233 .It Vt bus_dmasync_op_t
234 Memory synchronization operation specifier.
235 Bus DMA requires explicit synchronization of memory with it's device
236 visible mapping in order to guarantee memory coherency.
239 allows the type of DMA operation that will be or has been performed
240 to be communicated to the system so that the correct coherency measures
242 All operations specified below are performed from the CPU's
243 point of view (for a complete description, see the
246 .Bl -tag -width BUS_DMASYNC_POSTWRITE
247 .It Dv BUS_DMASYNC_PREREAD
248 Perform any synchronization required after an update of memory by the CPU
249 but prior to DMA read operations.
250 .It Dv BUS_DMASYNC_PREWRITE
251 Perform any synchronization required after an update of memory by the CPU
252 but prior to DMA write operations.
253 .It Dv BUS_DMASYNC_PREREAD|BUS_DMASYNC_PREWRITE
254 Perform any synchronization required prior to a combination of DMA read
255 and write operations.
256 .It Dv BUS_DMASYNC_POSTREAD
257 Perform any synchronization required after DMA read operations, but prior
258 to CPU access of the memory.
259 .It Dv BUS_DMASYNC_POSTWRITE
260 Perform any synchronization required after DMA write operations, but prior
261 to CPU access of the memory.
262 .It Dv BUS_DMASYNC_POSTREAD|BUS_DMASYNC_POSTWRITE
263 Perform any synchronization required after a combination of DMA read
264 and write operations.
266 .It Vt bus_dma_lock_t
267 Client specified lock/mutex manipulation method.
268 This will be called from
269 within busdma whenever a client lock needs to be manipulated.
270 This method is of the format:
271 .Bl -tag -width compact
273 .Fn "lockfunc" "void *lockfunc_arg" "bus_dma_lock_op_t op"
278 implementations are provided for convenience.
279 .Fn busdma_lock_mutex
280 performs standard mutex operations on the sleep mutex provided via the
283 .Fn bus_dma_tag_create .
285 will generate a system panic if it is called.
286 It is substituted into the tag when
289 .Fn bus_dma_tag_create .
290 .It Vt bus_dma_lock_op_t
291 Operations to be performed by the client-specified
293 .Bl -tag -width BUS_DMA_UNLOCK
295 Acquires and/or locks the client locking primitive.
296 .It Dv BUS_DMA_UNLOCK
297 Releases and/or unlocks the client locking primitive.
302 .Bl -tag -width compact
303 .It Fn bus_dma_tag_create "parent" "alignment" "boundary" "lowaddr" \
304 "highaddr" "*filtfunc" "*filtfuncarg" "maxsize" "nsegments" "maxsegsz" \
305 "flags" "lockfunc" "lockfuncarg" "*dmat"
306 Allocates a device specific DMA tag, and initializes it according to
307 the arguments provided:
308 .Bl -tag -width *filtfuncarg -compact
310 Indicates restrictions between the parent bridge, CPU memory, and the
312 May be NULL, if no DMA restrictions are to be inherited.
314 Alignment constraint, in bytes, of any mappings created using this tag.
315 The alignment must be a power of 2.
316 Hardware that can DMA starting at any address would specify
319 Hardware requiring DMA transfers to start on a multiple of 4K
323 Boundary constraint, in bytes, of the target DMA memory region.
324 The boundary indicates the set of addresses, all multiples of the
325 boundary argument, that cannot be crossed by a single
326 .Vt bus_dma_segment_t .
327 The boundary must be a power of 2 and must be no smaller that the
328 maximum segment size.
330 indicates that there are no boundary restrictions.
333 Bounds of the window of bus address space that
335 be directly accessed by the device.
336 The window contains all address greater than lowaddr and
337 less than or equal to highaddr.
338 For example, a device incapable of DMA above 4GB, would specify
340 .Dv BUS_SPACE_MAXADDR
342 .Dv BUS_SPACE_MAXADDR_32BIT .
343 Similarly a device that can only dma to addresses bellow 16MB would
344 specify a highaddr of
345 .Dv BUS_SPACE_MAXADDR
347 .Dv BUS_SPACE_MAXADDR_24BIT .
348 Some implementations requires that some region of device visible
349 address space, overlapping available host memory, be outside the
353 is used to bounce requests that would otherwise conflict with
354 the exclusion window.
356 Optional filter function (may be NULL) to be called for any attempt to
357 map memory into the window described by
361 A filter function is only required when the single window described
366 cannot adequately describe the constraints of the device.
367 The filter function will be called for every machine page
368 that overlaps the exclusion window.
370 Argument passed to all calls to the filter function for this tag.
373 Maximum size, in bytes, of the sum of all segment lengths in a given
374 DMA mapping associated with this tag.
376 Number of discontinuities (scatter/gather segments) allowed
377 in a DMA mapped region.
378 If there is no restriction,
379 .Dv BUS_SPACE_UNRESTRICTED
382 Maximum size, in bytes, of a segment in any DMA mapped region associated
387 .Bl -tag -width "BUS_DMA_ALLOCNOW" -compact
388 .It Dv BUS_DMA_ALLOCNOW
389 Allocate the resources necessary to guarantee that all map load
390 operations associated with this tag will not block.
391 If sufficient resources are not available,
396 Optional lock manipulation function (may be NULL) to be called when busdma
397 needs to manipulate a lock on behalf of the client.
398 If NULL is specified,
402 Optional argument to be passed to the function specified by
405 Pointer to a bus_dma_tag_t where the resulting DMA tag will
411 if sufficient memory is not available for tag creation
412 or allocating mapping resources.
413 .It Fn bus_dma_tag_destroy "dmat"
414 Deallocate the DMA tag
417 .Fn bus_dma_tag_create .
421 if any DMA maps remain associated with
426 .It Fn bus_dmamap_create "dmat" "flags" "*mapp"
427 Allocates and initializes a DMA map.
428 Arguments are as follows:
429 .Bl -tag -width nsegments -compact
433 The value of this argument is currently undefined and should be
439 where the resulting DMA map will be stored.
444 if sufficient memory is not available for creating the
445 map or allocating mapping resources.
446 .It Fn bus_dmamap_destroy "dmat" "map"
447 Frees all resources associated with a given DMA map.
448 Arguments are as follows:
449 .Bl -tag -width dmat -compact
451 DMA tag used to allocate
454 The DMA map to destroy.
459 if a mapping is still active for
461 .It Fn bus_dmamap_load "dmat" "map" "buf" "buflen" "*callback" "..."
462 Creates a mapping in device visible address space of
466 associated with the DMA map
468 Arguments are as follows:
469 .Bl -tag -width buflen -compact
471 DMA tag used to allocate
474 A DMA map without a currently active mapping.
476 A kernel virtual address pointer to a contiguous (in KVA) buffer, to be
477 mapped into device visible address space.
479 The size of the buffer.
480 .It Fa callback Fa callback_arg
481 The callback function, and its argument.
483 The value of this argument is currently undefined, and should be
488 Return values to the caller are as follows:
489 .Bl -tag -width EINPROGRESS -compact
491 The callback has been called and completed.
492 The status of the mapping has been delivered to the callback.
494 The mapping has been deferred for lack of resources.
495 The callback will be called as soon as resources are available.
496 Callbacks are serviced in FIFO order.
497 DMA maps created from DMA tags that are allocated with
500 flag will never return this status for a load operation.
502 The load request was invalid.
503 The callback has not, and will not be called.
504 This error value may indicate that
514 argument used to create the dma tag
518 When the callback is called, it is presented with an error value
519 indicating the disposition of the mapping.
520 Error may be one of the following:
521 .Bl -tag -width EINPROGRESS -compact
523 The mapping was successful and the
525 callback argument contains an array of
526 .Vt bus_dma_segment_t
527 elements describing the mapping.
528 This array is only valid during the scope of the callback function.
530 A mapping could not be achieved within the segment constraints provided
531 in the tag even though the requested allocation size was less than maxsize.
533 .It Fn bus_dmamap_load_mbuf "dmat" "map" "mbuf" "callback2" "callback_arg" \
535 This is a variation of
537 which maps mbuf chains
541 argument is also passed to the callback routine, which
542 contains the mbuf chain's packet header length.
544 Mbuf chains are assumed to be in kernel virtual address space.
548 if the size of the mbuf chain exceeds the maximum limit of the
550 .It Fn bus_dmamap_load_uio "dmat" "map" "uio" "callback2" "callback_arg" "flags"
551 This is a variation of
553 which maps buffers pointed to by
558 argument is also passed to the callback routine, which contains the size of
567 then it is assumed that the buffer,
570 .Fa "uio->uio_td->td_proc" Ns 's
572 User space memory must be in-core and wired prior to attempting a map
574 .It Fn bus_dmamap_unload "dmat" "map"
576 Arguments are as follows:
577 .Bl -tag -width dmam -compact
579 DMA tag used to allocate
582 The DMA map that is to be unloaded.
585 .Fn bus_dmamap_unload
586 will not perform any implicit synchronization of DMA buffers.
587 This must be done explicitly by a call to
589 prior to unloading the map.
590 .It Fn bus_dmamap_sync "dmat" "map" "op"
591 Performs synchronization of a device visible mapping with the CPU visible
592 memory referenced by that mapping.
593 Arguments are as follows:
594 .Bl -tag -width dmat -compact
596 DMA tag used to allocate
599 The DMA mapping to be synchronized.
601 Type of synchronization operation to perform.
602 See the definition of
604 for a description of the acceptable values for
609 is the method used to ensure that CPU and device DMA access to shared
611 For example, the CPU might be used to setup the contents of a buffer
612 that is to be DMA'ed into a device.
613 To ensure that the data are visible via the device's mapping of that
614 memory, the buffer must be loaded and a dma sync operation of
615 .Dv BUS_DMASYNC_PREREAD
617 Additional sync operations must be performed after every CPU write
618 to this memory if additional DMA reads are to be performed.
619 Conversely, for the DMA write case, the buffer must be loaded,
620 and a dma sync operation of
621 .Dv BUS_DMASYNC_PREWRITE
623 The CPU will only be able to see the results of this DMA write
624 once the DMA has completed and a
625 .Dv BUS_DMASYNC_POSTWRITE
626 operation has been performed.
628 If DMA read and write operations are not preceded and followed by the
629 appropriate synchronization operations, behavior is undefined.
630 .It Fn bus_dmamem_alloc "dmat" "**vaddr" "flags" "mapp"
631 Allocates memory that is mapped into KVA at the address returned
634 that is permanently loaded into the newly created
638 Arguments are as follows:
639 .Bl -tag -width alignment -compact
641 DMA tag describing the constraints of the DMA mapping.
643 Pointer to a pointer that will hold the returned KVA mapping of
644 the allocated region.
646 Flags are defined as follows:
647 .Bl -tag -width BUS_DMA_NOWAIT -compact
648 .It Dv BUS_DMA_WAITOK
649 The routine can safely wait (sleep) for resources.
650 .It Dv BUS_DMA_NOWAIT
651 The routine is not allowed to wait for resources.
652 If resources are not available,
655 .It Dv BUS_DMA_COHERENT
656 Attempt to map this memory such that cache sync operations are
657 as cheap as possible.
658 This flag is typically set on memory that will be accessed by both
659 a CPU and a DMA engine, frequently.
660 Use of this flag does not remove the requirement of using
661 bus_dmamap_sync, but it may reduce the cost of performing
664 Causes the allocated memory to be set to all zeros.
667 Pointer to storage for the returned DMA map.
670 The size of memory to be allocated is
675 The current implementation of
677 will allocate all requests as a single segment.
679 Although no explicit loading is required to access the memory
680 referenced by the returned map, the synchronization requirements
687 if sufficient memory is not available for completing
689 .It Fn bus_dmamem_free "dmat" "*vaddr" "map"
690 Frees memory previously allocated by
691 .Fn bus_dmamem_alloc .
694 Arguments are as follows:
695 .Bl -tag -width vaddr -compact
699 Kernel virtual address of the memory.
701 DMA map to be invalidated.
705 Behavior is undefined if invalid arguments are passed to
706 any of the above functions.
707 If sufficient resources cannot be allocated for a given
712 routines that are not of type,
714 will return 0 on success or an error
715 code, as discussed above.
719 routines will succeed if provided with valid arguments.
727 .%A "Jason R. Thorpe"
728 .%T "A Machine-Independent DMA Framework for NetBSD"
729 .%J "Proceedings of the Summer 1998 USENIX Technical Conference"
730 .%Q "USENIX Association"
736 interface first appeared in
743 for use in the CAM SCSI subsystem.
744 The alterations to the original API were aimed to remove the need for
746 .Vt bus_dma_segment_t
749 while allowing callers to queue up on scarce resources.
753 interface was designed and implemented by
755 of the Numerical Aerospace Simulation Facility, NASA Ames Research Center.
756 Additional input on the
758 design was provided by
760 .An Chris Demetriou ,
772 benefits from the contributions of
773 .An Justin T. Gibbs ,
776 .An Matthew N. Dodd ,
779 .An Jake Burkholder ,
780 .An Takahashi Yoshihiro ,
784 This manual page was written by
787 .An Justin T. Gibbs .