[SystemZ] Add CodeGen support for integer vector types
This the first of a series of patches to add CodeGen support exploiting
the instructions of the z13 vector facility. This patch adds support
for the native integer vector types (v16i8, v8i16, v4i32, v2i64).
When the vector facility is present, we default to the new vector ABI.
This is characterized by two major differences:
- Vector types are passed/returned in vector registers
(except for unnamed arguments of a variable-argument list function).
- Vector types are at most 8-byte aligned.
The reason for the choice of 8-byte vector alignment is that the hardware
is able to efficiently load vectors at 8-byte alignment, and the ABI only
guarantees 8-byte alignment of the stack pointer, so requiring any higher
alignment for vectors would require dynamic stack re-alignment code.
However, for compatibility with old code that may use vector types, when
*not* using the vector facility, the old alignment rules (vector types
are naturally aligned) remain in use.
These alignment rules are not only implemented at the C language level
(implemented in clang), but also at the LLVM IR level. This is done
by selecting a different DataLayout string depending on whether the
vector ABI is in effect or not.
Based on a patch by Richard Sandiford.
llvm-svn: 236521
2015-05-05 21:25:42 +02:00
|
|
|
; Test vector loads.
|
|
|
|
;
|
|
|
|
; RUN: llc < %s -mtriple=s390x-linux-gnu -mcpu=z13 | FileCheck %s
|
|
|
|
|
|
|
|
; Test v16i8 loads.
|
|
|
|
define <16 x i8> @f1(<16 x i8> *%ptr) {
|
|
|
|
; CHECK-LABEL: f1:
|
2019-06-19 16:20:00 +02:00
|
|
|
; CHECK: vl %v24, 0(%r2), 3
|
[SystemZ] Add CodeGen support for integer vector types
This the first of a series of patches to add CodeGen support exploiting
the instructions of the z13 vector facility. This patch adds support
for the native integer vector types (v16i8, v8i16, v4i32, v2i64).
When the vector facility is present, we default to the new vector ABI.
This is characterized by two major differences:
- Vector types are passed/returned in vector registers
(except for unnamed arguments of a variable-argument list function).
- Vector types are at most 8-byte aligned.
The reason for the choice of 8-byte vector alignment is that the hardware
is able to efficiently load vectors at 8-byte alignment, and the ABI only
guarantees 8-byte alignment of the stack pointer, so requiring any higher
alignment for vectors would require dynamic stack re-alignment code.
However, for compatibility with old code that may use vector types, when
*not* using the vector facility, the old alignment rules (vector types
are naturally aligned) remain in use.
These alignment rules are not only implemented at the C language level
(implemented in clang), but also at the LLVM IR level. This is done
by selecting a different DataLayout string depending on whether the
vector ABI is in effect or not.
Based on a patch by Richard Sandiford.
llvm-svn: 236521
2015-05-05 21:25:42 +02:00
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <16 x i8>, <16 x i8> *%ptr
|
|
|
|
ret <16 x i8> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test v8i16 loads.
|
|
|
|
define <8 x i16> @f2(<8 x i16> *%ptr) {
|
|
|
|
; CHECK-LABEL: f2:
|
2019-06-19 16:20:00 +02:00
|
|
|
; CHECK: vl %v24, 0(%r2), 3
|
[SystemZ] Add CodeGen support for integer vector types
This the first of a series of patches to add CodeGen support exploiting
the instructions of the z13 vector facility. This patch adds support
for the native integer vector types (v16i8, v8i16, v4i32, v2i64).
When the vector facility is present, we default to the new vector ABI.
This is characterized by two major differences:
- Vector types are passed/returned in vector registers
(except for unnamed arguments of a variable-argument list function).
- Vector types are at most 8-byte aligned.
The reason for the choice of 8-byte vector alignment is that the hardware
is able to efficiently load vectors at 8-byte alignment, and the ABI only
guarantees 8-byte alignment of the stack pointer, so requiring any higher
alignment for vectors would require dynamic stack re-alignment code.
However, for compatibility with old code that may use vector types, when
*not* using the vector facility, the old alignment rules (vector types
are naturally aligned) remain in use.
These alignment rules are not only implemented at the C language level
(implemented in clang), but also at the LLVM IR level. This is done
by selecting a different DataLayout string depending on whether the
vector ABI is in effect or not.
Based on a patch by Richard Sandiford.
llvm-svn: 236521
2015-05-05 21:25:42 +02:00
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <8 x i16>, <8 x i16> *%ptr
|
|
|
|
ret <8 x i16> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test v4i32 loads.
|
|
|
|
define <4 x i32> @f3(<4 x i32> *%ptr) {
|
|
|
|
; CHECK-LABEL: f3:
|
2019-06-19 16:20:00 +02:00
|
|
|
; CHECK: vl %v24, 0(%r2), 3
|
[SystemZ] Add CodeGen support for integer vector types
This the first of a series of patches to add CodeGen support exploiting
the instructions of the z13 vector facility. This patch adds support
for the native integer vector types (v16i8, v8i16, v4i32, v2i64).
When the vector facility is present, we default to the new vector ABI.
This is characterized by two major differences:
- Vector types are passed/returned in vector registers
(except for unnamed arguments of a variable-argument list function).
- Vector types are at most 8-byte aligned.
The reason for the choice of 8-byte vector alignment is that the hardware
is able to efficiently load vectors at 8-byte alignment, and the ABI only
guarantees 8-byte alignment of the stack pointer, so requiring any higher
alignment for vectors would require dynamic stack re-alignment code.
However, for compatibility with old code that may use vector types, when
*not* using the vector facility, the old alignment rules (vector types
are naturally aligned) remain in use.
These alignment rules are not only implemented at the C language level
(implemented in clang), but also at the LLVM IR level. This is done
by selecting a different DataLayout string depending on whether the
vector ABI is in effect or not.
Based on a patch by Richard Sandiford.
llvm-svn: 236521
2015-05-05 21:25:42 +02:00
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <4 x i32>, <4 x i32> *%ptr
|
|
|
|
ret <4 x i32> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test v2i64 loads.
|
|
|
|
define <2 x i64> @f4(<2 x i64> *%ptr) {
|
|
|
|
; CHECK-LABEL: f4:
|
2019-06-19 16:20:00 +02:00
|
|
|
; CHECK: vl %v24, 0(%r2), 3
|
[SystemZ] Add CodeGen support for integer vector types
This the first of a series of patches to add CodeGen support exploiting
the instructions of the z13 vector facility. This patch adds support
for the native integer vector types (v16i8, v8i16, v4i32, v2i64).
When the vector facility is present, we default to the new vector ABI.
This is characterized by two major differences:
- Vector types are passed/returned in vector registers
(except for unnamed arguments of a variable-argument list function).
- Vector types are at most 8-byte aligned.
The reason for the choice of 8-byte vector alignment is that the hardware
is able to efficiently load vectors at 8-byte alignment, and the ABI only
guarantees 8-byte alignment of the stack pointer, so requiring any higher
alignment for vectors would require dynamic stack re-alignment code.
However, for compatibility with old code that may use vector types, when
*not* using the vector facility, the old alignment rules (vector types
are naturally aligned) remain in use.
These alignment rules are not only implemented at the C language level
(implemented in clang), but also at the LLVM IR level. This is done
by selecting a different DataLayout string depending on whether the
vector ABI is in effect or not.
Based on a patch by Richard Sandiford.
llvm-svn: 236521
2015-05-05 21:25:42 +02:00
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <2 x i64>, <2 x i64> *%ptr
|
|
|
|
ret <2 x i64> %ret
|
|
|
|
}
|
|
|
|
|
2015-05-05 21:27:45 +02:00
|
|
|
; Test v4f32 loads.
|
|
|
|
define <4 x float> @f5(<4 x float> *%ptr) {
|
|
|
|
; CHECK-LABEL: f5:
|
2019-06-19 16:20:00 +02:00
|
|
|
; CHECK: vl %v24, 0(%r2), 3
|
2015-05-05 21:27:45 +02:00
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <4 x float>, <4 x float> *%ptr
|
|
|
|
ret <4 x float> %ret
|
|
|
|
}
|
|
|
|
|
2015-05-05 21:26:48 +02:00
|
|
|
; Test v2f64 loads.
|
|
|
|
define <2 x double> @f6(<2 x double> *%ptr) {
|
|
|
|
; CHECK-LABEL: f6:
|
2019-06-19 16:20:00 +02:00
|
|
|
; CHECK: vl %v24, 0(%r2), 3
|
2015-05-05 21:26:48 +02:00
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <2 x double>, <2 x double> *%ptr
|
|
|
|
ret <2 x double> %ret
|
|
|
|
}
|
|
|
|
|
[SystemZ] Add CodeGen support for integer vector types
This the first of a series of patches to add CodeGen support exploiting
the instructions of the z13 vector facility. This patch adds support
for the native integer vector types (v16i8, v8i16, v4i32, v2i64).
When the vector facility is present, we default to the new vector ABI.
This is characterized by two major differences:
- Vector types are passed/returned in vector registers
(except for unnamed arguments of a variable-argument list function).
- Vector types are at most 8-byte aligned.
The reason for the choice of 8-byte vector alignment is that the hardware
is able to efficiently load vectors at 8-byte alignment, and the ABI only
guarantees 8-byte alignment of the stack pointer, so requiring any higher
alignment for vectors would require dynamic stack re-alignment code.
However, for compatibility with old code that may use vector types, when
*not* using the vector facility, the old alignment rules (vector types
are naturally aligned) remain in use.
These alignment rules are not only implemented at the C language level
(implemented in clang), but also at the LLVM IR level. This is done
by selecting a different DataLayout string depending on whether the
vector ABI is in effect or not.
Based on a patch by Richard Sandiford.
llvm-svn: 236521
2015-05-05 21:25:42 +02:00
|
|
|
; Test the highest aligned in-range offset.
|
|
|
|
define <16 x i8> @f7(<16 x i8> *%base) {
|
|
|
|
; CHECK-LABEL: f7:
|
2019-06-19 16:20:00 +02:00
|
|
|
; CHECK: vl %v24, 4080(%r2), 3
|
[SystemZ] Add CodeGen support for integer vector types
This the first of a series of patches to add CodeGen support exploiting
the instructions of the z13 vector facility. This patch adds support
for the native integer vector types (v16i8, v8i16, v4i32, v2i64).
When the vector facility is present, we default to the new vector ABI.
This is characterized by two major differences:
- Vector types are passed/returned in vector registers
(except for unnamed arguments of a variable-argument list function).
- Vector types are at most 8-byte aligned.
The reason for the choice of 8-byte vector alignment is that the hardware
is able to efficiently load vectors at 8-byte alignment, and the ABI only
guarantees 8-byte alignment of the stack pointer, so requiring any higher
alignment for vectors would require dynamic stack re-alignment code.
However, for compatibility with old code that may use vector types, when
*not* using the vector facility, the old alignment rules (vector types
are naturally aligned) remain in use.
These alignment rules are not only implemented at the C language level
(implemented in clang), but also at the LLVM IR level. This is done
by selecting a different DataLayout string depending on whether the
vector ABI is in effect or not.
Based on a patch by Richard Sandiford.
llvm-svn: 236521
2015-05-05 21:25:42 +02:00
|
|
|
; CHECK: br %r14
|
|
|
|
%ptr = getelementptr <16 x i8>, <16 x i8> *%base, i64 255
|
|
|
|
%ret = load <16 x i8>, <16 x i8> *%ptr
|
|
|
|
ret <16 x i8> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test the highest unaligned in-range offset.
|
|
|
|
define <16 x i8> @f8(i8 *%base) {
|
|
|
|
; CHECK-LABEL: f8:
|
|
|
|
; CHECK: vl %v24, 4095(%r2)
|
|
|
|
; CHECK: br %r14
|
|
|
|
%addr = getelementptr i8, i8 *%base, i64 4095
|
|
|
|
%ptr = bitcast i8 *%addr to <16 x i8> *
|
|
|
|
%ret = load <16 x i8>, <16 x i8> *%ptr, align 1
|
|
|
|
ret <16 x i8> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test the next offset up, which requires separate address logic,
|
|
|
|
define <16 x i8> @f9(<16 x i8> *%base) {
|
|
|
|
; CHECK-LABEL: f9:
|
|
|
|
; CHECK: aghi %r2, 4096
|
2019-06-19 16:20:00 +02:00
|
|
|
; CHECK: vl %v24, 0(%r2), 3
|
[SystemZ] Add CodeGen support for integer vector types
This the first of a series of patches to add CodeGen support exploiting
the instructions of the z13 vector facility. This patch adds support
for the native integer vector types (v16i8, v8i16, v4i32, v2i64).
When the vector facility is present, we default to the new vector ABI.
This is characterized by two major differences:
- Vector types are passed/returned in vector registers
(except for unnamed arguments of a variable-argument list function).
- Vector types are at most 8-byte aligned.
The reason for the choice of 8-byte vector alignment is that the hardware
is able to efficiently load vectors at 8-byte alignment, and the ABI only
guarantees 8-byte alignment of the stack pointer, so requiring any higher
alignment for vectors would require dynamic stack re-alignment code.
However, for compatibility with old code that may use vector types, when
*not* using the vector facility, the old alignment rules (vector types
are naturally aligned) remain in use.
These alignment rules are not only implemented at the C language level
(implemented in clang), but also at the LLVM IR level. This is done
by selecting a different DataLayout string depending on whether the
vector ABI is in effect or not.
Based on a patch by Richard Sandiford.
llvm-svn: 236521
2015-05-05 21:25:42 +02:00
|
|
|
; CHECK: br %r14
|
|
|
|
%ptr = getelementptr <16 x i8>, <16 x i8> *%base, i64 256
|
|
|
|
%ret = load <16 x i8>, <16 x i8> *%ptr
|
|
|
|
ret <16 x i8> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test negative offsets, which also require separate address logic,
|
|
|
|
define <16 x i8> @f10(<16 x i8> *%base) {
|
|
|
|
; CHECK-LABEL: f10:
|
|
|
|
; CHECK: aghi %r2, -16
|
2019-06-19 16:20:00 +02:00
|
|
|
; CHECK: vl %v24, 0(%r2), 3
|
[SystemZ] Add CodeGen support for integer vector types
This the first of a series of patches to add CodeGen support exploiting
the instructions of the z13 vector facility. This patch adds support
for the native integer vector types (v16i8, v8i16, v4i32, v2i64).
When the vector facility is present, we default to the new vector ABI.
This is characterized by two major differences:
- Vector types are passed/returned in vector registers
(except for unnamed arguments of a variable-argument list function).
- Vector types are at most 8-byte aligned.
The reason for the choice of 8-byte vector alignment is that the hardware
is able to efficiently load vectors at 8-byte alignment, and the ABI only
guarantees 8-byte alignment of the stack pointer, so requiring any higher
alignment for vectors would require dynamic stack re-alignment code.
However, for compatibility with old code that may use vector types, when
*not* using the vector facility, the old alignment rules (vector types
are naturally aligned) remain in use.
These alignment rules are not only implemented at the C language level
(implemented in clang), but also at the LLVM IR level. This is done
by selecting a different DataLayout string depending on whether the
vector ABI is in effect or not.
Based on a patch by Richard Sandiford.
llvm-svn: 236521
2015-05-05 21:25:42 +02:00
|
|
|
; CHECK: br %r14
|
|
|
|
%ptr = getelementptr <16 x i8>, <16 x i8> *%base, i64 -1
|
|
|
|
%ret = load <16 x i8>, <16 x i8> *%ptr
|
|
|
|
ret <16 x i8> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Check that indexes are allowed.
|
|
|
|
define <16 x i8> @f11(i8 *%base, i64 %index) {
|
|
|
|
; CHECK-LABEL: f11:
|
|
|
|
; CHECK: vl %v24, 0(%r3,%r2)
|
|
|
|
; CHECK: br %r14
|
|
|
|
%addr = getelementptr i8, i8 *%base, i64 %index
|
|
|
|
%ptr = bitcast i8 *%addr to <16 x i8> *
|
|
|
|
%ret = load <16 x i8>, <16 x i8> *%ptr, align 1
|
|
|
|
ret <16 x i8> %ret
|
|
|
|
}
|
2015-05-05 21:32:57 +02:00
|
|
|
|
|
|
|
; Test v2i8 loads.
|
|
|
|
define <2 x i8> @f12(<2 x i8> *%ptr) {
|
|
|
|
; CHECK-LABEL: f12:
|
|
|
|
; CHECK: vlreph %v24, 0(%r2)
|
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <2 x i8>, <2 x i8> *%ptr
|
|
|
|
ret <2 x i8> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test v4i8 loads.
|
|
|
|
define <4 x i8> @f13(<4 x i8> *%ptr) {
|
|
|
|
; CHECK-LABEL: f13:
|
|
|
|
; CHECK: vlrepf %v24, 0(%r2)
|
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <4 x i8>, <4 x i8> *%ptr
|
|
|
|
ret <4 x i8> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test v8i8 loads.
|
|
|
|
define <8 x i8> @f14(<8 x i8> *%ptr) {
|
|
|
|
; CHECK-LABEL: f14:
|
|
|
|
; CHECK: vlrepg %v24, 0(%r2)
|
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <8 x i8>, <8 x i8> *%ptr
|
|
|
|
ret <8 x i8> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test v2i16 loads.
|
|
|
|
define <2 x i16> @f15(<2 x i16> *%ptr) {
|
|
|
|
; CHECK-LABEL: f15:
|
|
|
|
; CHECK: vlrepf %v24, 0(%r2)
|
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <2 x i16>, <2 x i16> *%ptr
|
|
|
|
ret <2 x i16> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test v4i16 loads.
|
|
|
|
define <4 x i16> @f16(<4 x i16> *%ptr) {
|
|
|
|
; CHECK-LABEL: f16:
|
|
|
|
; CHECK: vlrepg %v24, 0(%r2)
|
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <4 x i16>, <4 x i16> *%ptr
|
|
|
|
ret <4 x i16> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test v2i32 loads.
|
|
|
|
define <2 x i32> @f17(<2 x i32> *%ptr) {
|
|
|
|
; CHECK-LABEL: f17:
|
|
|
|
; CHECK: vlrepg %v24, 0(%r2)
|
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <2 x i32>, <2 x i32> *%ptr
|
|
|
|
ret <2 x i32> %ret
|
|
|
|
}
|
|
|
|
|
|
|
|
; Test v2f32 loads.
|
|
|
|
define <2 x float> @f18(<2 x float> *%ptr) {
|
|
|
|
; CHECK-LABEL: f18:
|
|
|
|
; CHECK: vlrepg %v24, 0(%r2)
|
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <2 x float>, <2 x float> *%ptr
|
|
|
|
ret <2 x float> %ret
|
|
|
|
}
|
2019-06-19 16:20:00 +02:00
|
|
|
|
|
|
|
; Test quadword-aligned loads.
|
|
|
|
define <16 x i8> @f19(<16 x i8> *%ptr) {
|
|
|
|
; CHECK-LABEL: f19:
|
|
|
|
; CHECK: vl %v24, 0(%r2), 4
|
|
|
|
; CHECK: br %r14
|
|
|
|
%ret = load <16 x i8>, <16 x i8> *%ptr, align 16
|
|
|
|
ret <16 x i8> %ret
|
|
|
|
}
|
|
|
|
|